CoREC
Authors:
Open Access
- 18 May 2020
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Parallel Computing
- Vol. 7 (2) , 1-29
Abstract
The dramatic increase in the scale of current and planned high-end HPC systems is leading new challenges, such as the growing costs of data movement and IO, and the reduced mean time between failures (MTBF) of system components. In-situ workflows, i.e., executing the entire application workflows on the HPC system, have emerged as an attractive approach to address data-related challenges by moving computations closer to the data, and staging-based frameworks have been effectively used to support in-situ workflows at scale. However, the resilience of these staging-based solutions has not been addressed, and they remain susceptible to expensive data failures. Furthermore, naive use of data resilience techniques such as n-way replication and erasure codes can impact latency and/or result in significant storage overheads. In this article, we present CoREC, a scalable and resilient in-memory data staging runtime for large-scale in-situ workflows. CoREC uses a novel hybrid approach that combines dynamic replication with erasure coding based on data access patterns. It also leverages multiple levels of replications and erasure coding to support diverse data resiliency requirements. Furthermore, the article presents optimizations for load balancing and conflict-avoiding encoding, and a low overhead, lazy data recovery scheme. We have implemented the CoREC runtime and have deployed with the DataSpaces staging service on leadership class computing machines and present an experimental evaluation in the article. The experiments demonstrate that CoREC can tolerate in-memory data failures while maintaining low latency and sustaining high overall storage efficiency at large scales.Keywords
Funding Information
- Sandia National Laboratories (DE-NA-0003525)
- the National Science Foundation (CCF 1725649)
This publication has 29 references indexed in Scilit:
- AnalyzeThis2015
- Real-Time In-Memory Checkpointing for Future Hybrid Memory Systems2015
- ActiveSpaces: Exploring dynamic code deployment for extreme scale data processingConcurrency and Computation: Practice and Experience, 2014
- Toward Exascale Resilience: 2014 updateSupercomputing Frontiers and Innovations, 2014
- Post-failure recovery of MPI communication capabilityThe International Journal of High Performance Computing Applications, 2013
- A survey of fault tolerance mechanisms and checkpoint/restart implementations for high performance computing systemsThe Journal of Supercomputing, 2013
- An Evaluation of User-Level Failure Mitigation Support in MPI2012
- DataSpaces: an interaction and coordination framework for coupled simulation workflowsCluster Computing, 2011
- Terascale direct numerical simulations of turbulent combustion using S3DComputational Science & Discovery, 2009
- Polynomial Codes Over Certain Finite FieldsJournal of the Society for Industrial and Applied Mathematics, 1960