SC Conference - Activity Details

A Dynamic Scheduler for Balancing HPC Applications

Carlos Boneti  (Universitat Politecnica de Catalunya)
Roberto Gioiosa  (Barcelona Supercomputing Center)
Francisco Cazorla  (Barcelona Supercomputing Center)
Mateo Valero  (Universitat Politecnica de Catalunya)
Papers Session
Thursday,  11:00AM - 11:30AM
Room Ballroom F
Load imbalance causes significant performance degradation in High Performance Computing applications. In our previous work we showed that load imbalance can be alleviated by modern MT processors that provide mechanisms for controlling the allocation of processor's internal resources. In that work, we applied static, hand-tuned resource allocations to balance HPC applications, providing improvements for benchmarks and real applications. In this paper we propose a dynamic process scheduler for the Linux kernel that automatically and transparently balances HPC applications according to their behavior. We tested our new scheduler on an IBM POWER5 machine, which provides a software-controlled prioritization mechanism that allows us to bias the processor resource allocation. Our experiments show that the scheduler reduces the imbalance of HPC applications, achieving results similar to the ones obtained by hand-tuning the applications (up to 16%). Moreover, our solution reduces the application's execution time combining effect of load balance and high responsive scheduling.
The full paper can be found in the IEEE Xplore Digital Library and ACM Digital Library
   IEEE Computer Society  /  ACM     2 0   Y E A R S   -   U N L E A S H I N G   T H E   P O W E R   O F   H P C