headerlogo
scyourway
Award Finalist/Winner

SC Conference - Activity Details



Creating a Regional Data Grid using Commodity Protocols

Contributors:
Patrick Finnegan  (Purdue University)
Michael Shuey  (Purdue University)
Greg Veldman  (Purdue University)
Ramon Williamson  (Purdue University)
James Reaney  (BlueArc Corporation)
Beth Pastusek  (Texas Memory Systems, Inc.)
Challenges Session
SC08 Bandwidth Challenge: Unleashing the Power of the Network
Tuesday,  02:15PM - 02:30PM
Room 17A/17B
Abstract:
Moving scientific data is rapidly becoming an impediment to modern large-scale simulation. In certain disciplines, moving dozens (if not hundreds) of terabytes of data between compute facilities is required -- usually necessitating complex tools to perform data transfer at high speeds. Much effort has been spent on complex data cataloging and transfer systems, as long-distance remote file system access has generally been deemed impossible. Recently, several groups are looking to make direct file system access a viable option, but this generally involves very complex protocols that are frequently beyond the capabilities of a smaller institution or research group. We propose the use of a regional data grid using a high-speed NAS and using the existing (and widely accepted and implemented) NFS protocol to provide a stable data grid that is easy to implement and maintain. In this experiment, we will implement such a grid and fine tune NFS server and client parameters to optimize throughput while minimizing the effects of network latency between distant sites.
   IEEE Computer Society  /  ACM     2 0   Y E A R S   -   U N L E A S H I N G   T H E   P O W E R   O F   H P C