|
|
SC Conference - Activity Details
BitDew: A Programmable Environment for Large-Scale Data Management and Distribution
Authors:
Gilles Fedak
(INRIA)
|
Haiwu He
(INRIA)
|
Franck Cappello
(INRIA)
|
Papers Session
Visualization and Data Management
|
Thursday, 01:30PM - 02:00PM
|
Room Ballroom G
|
Abstract:
Desktop Grids use the computing, network and storage resources from idle
desktop PC's distributed over multiple-LAN's or the Internet to compute
a large variety of resource-demanding distributed applications.
While these applications need to access, compute, store and circulate
large volumes of data, little attention has been paid to data
management in such large-scale, dynamic, heterogeneous, volatile and highly
distributed Grids.
To address this problem, we propose the BitDew framework, a
programmable environment for automatic and transparent data management on
computational Desktop Grids. This paper describes the BitDew
programming interface, its architecture, and the
performance evaluation of its runtime components. BitDew relies on
a specific set of meta-data to drive key data management operations, namely
life cycle, distribution, placement, replication and fault-tolerance
with a high level of abstraction. The performance
evaluation demonstrates a reasonable overhead, while offering
the benefit of scalability, performance and fault tolerance with
little programming cost.
|
|