Stochastic models of load balancing and scheduling in cloud computing clusters
Authors:
Top Cited Papers
- 1 March 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 0743166X,p. 702-710
Abstract
Cloud computing services are becoming ubiquitous, and are starting to serve as the primary source of computing power for both enterprises and personal computing applications. We consider a stochastic model of a cloud computing cluster, where jobs arrive according to a stochastic process and request virtual machines (VMs), which are specified in terms of resources such as CPU, memory and storage space. While there are many design issues associated with such systems, here we focus only on resource allocation problems, such as the design of algorithms for load balancing among servers, and algorithms for scheduling VM configurations. Given our model of a cloud, we first define its capacity, i.e., the maximum rates at which jobs can be processed in such a system. Then, we show that the widely-used Best-Fit scheduling algorithm is not throughput-optimal, and present alternatives which achieve any arbitrary fraction of the capacity region of the cloud. We then study the delay performance of these alternative algorithms through simulations.Keywords
This publication has 12 references indexed in Scilit:
- Stochastic models of load balancing and scheduling in cloud computing clusters2012
- Consolidating virtual machines with dynamic bandwidth demand in data centers2011
- Kingfisher: Cost-aware elasticity in the cloud2011
- A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data CentersIEEE Transactions on Services Computing, 2010
- Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement2010
- Energy Efficient Allocation of Virtual Machines in Cloud Data Centers2010
- Markov Chains and Stochastic Stability2009
- Cloud Computing and Grid Computing 360-Degree Compared2008
- Limited choice and locality considerations for load balancingPerformance Evaluation, 2008
- Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networksIEEE Transactions on Automatic Control, 1992