Reducing Costs of Spot Instances via Checkpointing in the Amazon Elastic Compute Cloud
Authors:
- Sangho YiSYSangho Yi
- Derrick KondoDKDerrick Kondo
- Artur AndrzejakAAArtur Andrzejak
- 1 July 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21596182,p. 236-243
Abstract
Recently introduced spot instances in the Amazon Elastic Compute Cloud (EC2) offer lower resource costs in exchange for reduced reliability; these instances can be revoked abruptly due to price and demand fluctuations. Mechanisms and tools that deal with the cost-reliability trade-offs under this schema are of great value for users seeking to lessen their costs while maintaining high reliability. We study how one such a mechanism, namely check pointing, can be used to minimize the cost and volatility of resource provisioning. Based on the real price history of EC2 spot instances, we compare several adaptive check pointing schemes in terms of monetary costs and improvement of job completion times. Trace-based simulations show that our approach can reduce significantly both price and the task completion times.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Exploiting non-dedicated resources for cloud computing2010
- Cost-benefit analysis of Cloud Computing versus desktop grids2009
- The cost of doing science on the cloud: The Montage example2008
- On correlated availability in Internet-distributed systems2008
- Amazon S3 for science grids2008
- Exploring event correlation for failure prediction in coalitions of clusters2007
- Adaptive page-level incremental checkpointing based on expected recovery time2006
- Condor-a hunter of idle workstations2003
- MPICH-V: Toward a Scalable Fault Tolerant MPI for Volatile Nodes2002
- The effects of checkpointing on program execution timeInformation Processing Letters, 1983