Cost-oriented proactive fault tolerance approach to high performance computing (HPC) in the cloud
- 5 November 2013
- journal article
- research article
- Published by Taylor & Francis in International Journal of Parallel, Emergent and Distributed Systems
- Vol. 29 (4) , 363-378
Abstract
Cloud computing offers new computing paradigms, capacity and flexible solutions to high performance computing (HPC) applications. For example, Hardware as a Service (HaaS) allows users to provide a large number of virtual machines (VMs) for computation-intensive applications using the HaaS model. Due to the large number of VMs and electronic components in HPC system in the cloud, any fault during the execution would result in re-running the applications, which will cost time, money and energy. In this paper we presented a proactive fault tolerance (FT) approach to HPC systems in the cloud to reduce the wall-clock execution time and dollar cost in the presence of faults. We also developed a generic FT algorithm for HPC systems in the cloud. Our algorithm does not rely on a spare node prior to prediction of a failure. We also developed a cost model for executing computation-intensive applications on HPC systems in the cloud. We analysed the dollar cost of provisioning spare nodes and checkpointing FT to assess the value of our approach. Our experimental results obtained from a real cloud execution environment show that the wall-clock execution time and cost of running computation-intensive applications in cloud can be reduced by as much as 30%. The frequency of checkpointing of computation-intensive applications can be reduced up to 50% with our FT approach for HPC in the cloud compared with current FT approaches.Keywords
This publication has 16 references indexed in Scilit:
- A Proactive Fault Tolerance Approach to High Performance Computing (HPC) in the Cloud2012
- See applications run and throughput jump: The case for redundant computing in HPC2010
- A view of cloud computingCommunications of the ACM, 2010
- Cost-oriented task allocation and hardware redundancy policies in heterogeneous distributed computing systems considering software reliabilityComputers & Industrial Engineering, 2009
- System-Level Dynamic Thermal Management for High-Performance MicroprocessorsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2007
- A higher order estimate of the optimum checkpoint interval for restart dumpsFuture Generation Computer Systems, 2006
- Optimal task allocation and hardware redundancy policies in distributed computing systemsEuropean Journal of Operational Research, 2003
- A survey of rollback-recovery protocols in message-passing systemsACM Computing Surveys, 2002
- GROMACS: A message-passing parallel molecular dynamics implementationComputer Physics Communications, 1995
- Low-latency, concurrent checkpointing for parallel programsIEEE Transactions on Parallel and Distributed Systems, 1994