SC Conference - Activity Details

Wide-Area Performance Profiling of 10GigE and Infiniband Technologies

Nageswara S. V. Rao  (Oak Ridge National Laboratory)
Weikuan Yu  (Oak Ridge National Laboratory)
William R. Wing  (Oak Ridge National Laboratory)
Stephen W. Poole  (Oak Ridge National Laboratory)
Jeffrey S. Vetter  (Oak Ridge National Laboratory)
Papers Session
Tuesday,  02:00PM - 02:30PM
Room Ballroom F
For wide-area high-performance applications, light-paths provide 10Gbps connectivity, and multi-core hosts with PCI-Express can drive such data rates. However, sustaining such end-to-end throughputs across connections of thousands of miles remains challenging, and the current performance studies of such solutions are very limited. We present an experimental study of two solutions based on different technologies to achieve such throughputs: (a) 10Gbps Ethernet with TCP/IP transport protocols, and (b) InfiniBand and its wide-area extensions. For both, we generate performance profiles over 10Gbps connections of lengths up to 8600 miles, and discuss the components, complexity, optimizations and limitations of sustaining such throughputs, using various connections and host configurations. IB solution is better suited for applications with a single large flow, and 10GigE solution is better for those with multiple competing flows. Furthermore, wide-area IB enables applications to transparently operate across thousands of miles at multiple Gbps rates using native IB-based message passing protocol.
The full paper can be found in the IEEE Xplore Digital Library and ACM Digital Library
   IEEE Computer Society  /  ACM     2 0   Y E A R S   -   U N L E A S H I N G   T H E   P O W E R   O F   H P C