Fault Tolerance in Petascale/ Exascale Systems: Current Knowledge, Challenges and Research Opportunities
- 20 July 2009
- journal article
- research article
- Published by SAGE Publications in The International Journal of High Performance Computing Applications
- Vol. 23 (3) , 212-226
Abstract
The emergence of petascale systems and the promise of future exascale systems have reinvigorated the community interest in how to manage failures in such systems and ensure that large applications, lasting several hours or tens of hours, are completed successfully. Most of the existing results for several key mechanisms associated with fault tolerance in high-performance computing (HPC) platforms follow the rollback—recovery approach. Over the last decade, these mechanisms have received a lot of attention from the community with different levels of success. Unfortunately, despite their high degree of optimization, existing approaches do not fit well with the challenging evolutions of large-scale systems. There is room and even a need for new approaches. Opportunities may come from different origins: diskless checkpointing, algorithmic-based fault tolerance, proactive operation, speculative execution, software transactional memory, forward recovery, etc. The contributions of this paper are as follows: (1) we summarize and analyze the existing results concerning the failures in large-scale computers and point out the urgent need for drastic improvements or disruptive approaches for fault tolerance in these systems; (2) we sketch most of the known opportunities and analyze their associated limitations; (3) we extract and express the challenges that the HPC community will have to face for addressing the stringent issue of failures in HPC systems.Keywords
This publication has 9 references indexed in Scilit:
- Understanding failures in petascale computersJournal of Physics: Conference Series, 2007
- P2P-MPI: A Peer-to-Peer Framework for Robust Execution of Message Passing Parallel Programs on GridsJournal of Grid Computing, 2006
- A survey of rollback-recovery protocols in message-passing systemsACM Computing Surveys, 2002
- Mesh Free Methods2002
- Memory exclusion: optimizing the performance of checkpointing systemsSoftware: Practice and Experience, 1999
- Diskless checkpointingIEEE Transactions on Parallel and Distributed Systems, 1998
- Distributed snapshotsACM Transactions on Computer Systems, 1985
- Algorithm-Based Fault Tolerance for Matrix OperationsIEEE Transactions on Computers, 1984
- Self-stabilizing systems in spite of distributed controlCommunications of the ACM, 1974