Hybrid checkpointing using emerging nonvolatile memories for future exascale systems
Authors:
Open Access
- 22 June 2011
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 8 (2) , 1-29
Abstract
The scalability of future Massively Parallel Processing (MPP) systems is being severely challenged by high failure rates. Current centralized Hard Disk Drive (HDD) checkpointing results in overhead of 25% or more at petascale. Since systems become more vulnerable as the node count keeps increasing, novel techniques that enable fast and frequent checkpointing are critical to the future exascale system implementation. In this work, we first introduce one of the emerging nonvolatile memory technologies, Phase-Change Random Access Memory (PCRAM), as a proper candidate of the fast checkpointing device. After a thorough analysis of MPP systems, failure rates and failure sources, we propose a PCRAM-based hybrid local/global checkpointing mechanism which not only provides a faster checkpoint storage, but also boosts the effectiveness of other orthogonal techniques such as incremental checkpointing and background checkpointing. Three variant implementations of the PCRAM-based hybrid checkpointing are designed to be adopted at different stages and to offer a smooth transition from the conventional in-disk checkpointing to the instant in-memory approach. Analyzing the overhead by using a hybrid checkpointing performance model, we show the proposed approach only incurs less than 3% performance overhead on a projected exascale system.Keywords
Funding Information
- National Science Foundation (7.03E+26)
This publication has 29 references indexed in Scilit:
- Fault Tolerance in Petascale/ Exascale Systems: Current Knowledge, Challenges and Research OpportunitiesThe International Journal of High Performance Computing Applications, 2009
- Compiler-enhanced incremental checkpointing for OpenMP applications2008
- Design space exploration for 3D architecturesACM Journal on Emerging Technologies in Computing Systems, 2006
- A higher order estimate of the optimum checkpoint interval for restart dumpsFuture Generation Computer Systems, 2006
- Designing Reliable Systems from Unreliable Components: The Challenges of Transistor Variability and DegradationIEEE Micro, 2005
- Scaling analysis of phase-change memory technology2004
- A survey of rollback-recovery protocols in message-passing systemsACM Computing Surveys, 2002
- Diskless checkpointingIEEE Transactions on Parallel and Distributed Systems, 1998
- Distributed snapshotsACM Transactions on Computer Systems, 1985
- A first order approximation to the optimum checkpoint intervalCommunications of the ACM, 1974