headerlogo
scyourway

SC Conference - Activity Details



BitDew: A Programmable Environment for Large-Scale Data Management and Distribution

Authors:
Gilles Fedak  (INRIA)
Haiwu He  (INRIA)
Franck Cappello  (INRIA)
Papers Session
Visualization and Data Management
Thursday,  01:30PM - 02:00PM
Room Ballroom G
Abstract:
Desktop Grids use the computing, network and storage resources from idle desktop PC's distributed over multiple-LAN's or the Internet to compute a large variety of resource-demanding distributed applications. While these applications need to access, compute, store and circulate large volumes of data, little attention has been paid to data management in such large-scale, dynamic, heterogeneous, volatile and highly distributed Grids. To address this problem, we propose the BitDew framework, a programmable environment for automatic and transparent data management on computational Desktop Grids. This paper describes the BitDew programming interface, its architecture, and the performance evaluation of its runtime components. BitDew relies on a specific set of meta-data to drive key data management operations, namely life cycle, distribution, placement, replication and fault-tolerance with a high level of abstraction. The performance evaluation demonstrates a reasonable overhead, while offering the benefit of scalability, performance and fault tolerance with little programming cost.
The full paper can be found in the IEEE Xplore Digital Library and ACM Digital Library
   IEEE Computer Society  /  ACM     2 0   Y E A R S   -   U N L E A S H I N G   T H E   P O W E R   O F   H P C