Elastic Site: Using Clouds to Elastically Extend Site Resources
Authors:
- Paul MarshallPMPaul Marshall
- Kate KeaheyKKKate Keahey
- Tim FreemanTFTim Freeman
- 1 January 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 43-52
Abstract
Infrastructure-as-a-Service (IaaS) cloud computing offers new possibilities to scientific communities. One of the most significant is the ability to elastically provision and relinquish new resources in response to changes in demand. In our work, we develop a model of an “elastic site” that efficiently adapts services provided within a site, such as batch schedulers, storage archives, or Web services to take advantage of elastically provisioned resources. We describe the system architecture along with the issues involved with elastic provisioning, such as security, privacy, and various logistical considerations. To avoid over- or under-provisioning the resources we propose three different policies to efficiently schedule resource deployment based on demand. We have implemented a resource manager, built on the Nimbus toolkit to dynamically and securely extend existing physical clusters into the cloud. Our elastic site manager interfaces directly with local resource managers, such as Torque. We have developed and evaluated policies for resource provisioning on a Nimbus-based cloud at the University of Chicago, another at Indiana University, and Amazon EC2. We demonstrate a dynamic and responsive elastic cluster, capable of responding effectively to a variety of job submission patterns. We also demonstrate that we can process 10 times faster by expanding our cluster up to 150 EC2 nodes.Keywords
This publication has 12 references indexed in Scilit:
- Can cloud computing reach the top500?2009
- Dynamic Provisioning of Virtual Organization Clusters2009
- Contextualization: Providing One-Click Virtual Clusters2008
- Many-task computing for grids and supercomputers2008
- Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure2006
- A case for high performance computing with virtual machines2006
- VioCluster: Virtualization for Dynamic Computational Domains2005
- Virtual Workspaces: Achieving Quality of Service and Quality of Life in the GridScientific Programming, 2005
- Globus Toolkit Version 4: Software for Service-Oriented Systems2005
- The Anatomy of the Grid: Enabling Scalable Virtual OrganizationsThe International Journal of High Performance Computing Applications, 2001