Dynamic Malleability in Iterative MPI Applications
- 1 May 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 591-598
Abstract
Malleability enables a parallel application's execution system to split or merge processes modifying granularity. While process migration is widely used to adapt applications to dynamic execution environments, it is limited by the granularity of the application's processes. Malleability empowers process migration by allowing the application's processes to expand or shrink following the availability of resources. We have implemented malleability as an extension to the PCM (process checkpointing and migration) library, a user-level library for iterative MPI applications. PCM is integrated with the Internet operating system (IOS), a framework for middleware-driven dynamic application reconfiguration. Our approach requires minimal code modifications and enables transparent middleware- triggered reconfiguration. Experimental results using a two-dimensional data parallel program that has a regular communication structure demonstrate the usefulness of malleability.Keywords
This publication has 9 references indexed in Scilit:
- The Internet Operating System: Middleware for Adaptive Distributed ComputingThe International Journal of High Performance Computing Applications, 2006
- Implementing malleability on MPI jobs2004
- A Simple MPI Process Swapping Architecture for Iterative ApplicationsThe International Journal of High Performance Computing Applications, 2004
- Dyn-MPI2003
- Phoenix2003
- SRS: A FRAMEWORK FOR DEVELOPING MALLEABLE AND MIGRATABLE PARALLEL APPLICATIONS FOR DISTRIBUTED SYSTEMSParallel Processing Letters, 2003
- Starfish: fault-tolerant dynamic MPI programs on clusters of workstations2003
- CoCheck: checkpointing and process migration for MPI2002
- Toward convergence in job schedulers for parallel supercomputers1996