Implementation and Evaluation of a Scalable Application-Level Checkpoint-Recovery Scheme for MPI Programs
Authors:
- 1 April 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 38
Abstract
The running times of many computational science applications are much longer than the mean-time-to-failure of current high-performance computing platforms. To run to completion, such applications must tolerate hardware failures. Checkpoint-and-restart (CPR) is the most commonly used scheme for accomplishing this - the state of the computation is saved periodically on stable storage, and when a hardware failure is detected, the computation is restarted from the most recently saved state. Most automatic CPR schemes in the literature can be classified as system-level checkpointing schemes because they take core-dump style snapshots of the computational state when all the processes are blocked at global barriers in the program. Unfortunately, a system that implements this style of checkpointing is tied to a particular platform; in addition, it cannot be used if there are no global barriers in the program. We are exploring an alternative called application-level, non-blocking checkpointing. In our approach, programs are transformed by a pre-processor so that they become self-checkpointing and self-restartable on any platform; there is also no assumption about the existence of global barriers in the code. In this paper, we describe our implementation of application-level, non-blocking checkpointing. We present experimental results on both a Windows cluster and a Compaq Alpha cluster, which show that the overheads introduced by our approach are small.Keywords
This publication has 13 references indexed in Scilit:
- Automated application-level checkpointing of MPI programs2003
- SRS: A FRAMEWORK FOR DEVELOPING MALLEABLE AND MIGRATABLE PARALLEL APPLICATIONS FOR DISTRIBUTED SYSTEMSParallel Processing Letters, 2003
- Egida: an extensible toolkit for low-overhead fault-tolerance2003
- Starfish: fault-tolerant dynamic MPI programs on clusters of workstations2003
- CoCheck: checkpointing and process migration for MPI2002
- A survey of rollback-recovery protocols in message-passing systemsACM Computing Surveys, 2002
- Application Level Fault Tolerance in Heterogeneous Networks of WorkstationsJournal of Parallel and Distributed Computing, 1997
- Direct Bulk-Synchronous Parallel AlgorithmsJournal of Parallel and Distributed Computing, 1994
- Manetho: transparent roll back-recovery with low overhead, limited rollback, and fast output commitIEEE Transactions on Computers, 1992
- Distributed snapshotsACM Transactions on Computer Systems, 1985