Towards Designing Cost-Optimal Policies to Utilize IaaS Clouds under Online Learning
Preprint
Abstract
Many businesses possess a small infrastructure that they can use for their computing tasks, but also often buy extra computing resources from clouds. Cloud vendors such as Amazon EC2 offer two types of purchase options: on-demand and spot instances. As tenants have limited budgets to satisfy their computing needs, it is crucial for them to determine how to purchase different options and utilize them (in addition to possible self-owned instances) in a cost-effective manner while respecting their response-time targets. In this paper, we propose a framework to design policies to allocate self-owned, on-demand and spot instances to arriving jobs. In particular, we propose a near-optimal policy to determine the number of self-owned instance and an optimal policy to determine the number of on-demand instances to buy and the number of spot instances to bid for at each time unit. Our policies rely on a small number of parameters and we use an online learning technique to infer their optimal values. Through numerical simulations, we show the effectiveness of our proposed policies, in particular that they achieve a cost reduction of up to 64.51% when spot and on-demand instances are considered and of up to 43.74% when self-owned instances are considered, compared to previously proposed or intuitive policies.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- A Framework for Allocating Server Time to Spot and On-Demand Services in Cloud ComputingACM Transactions on Modeling and Performance Evaluation of Computing Systems, 2019
- A Survey on Spot Pricing in Cloud ComputingJournal of Network and Systems Management, 2017
- Resource Provisioning and Profit Maximization for Transcoding in Clouds: A Two-Timescale ApproachIEEE Transactions on Multimedia, 2016
- Near-Optimal Scheduling Mechanisms for Deadline-Sensitive Jobs in Large Computing ClustersACM Transactions on Parallel Computing, 2015
- Optimal Online Multi-Instance Acquisition in IaaS CloudsIEEE Transactions on Parallel and Distributed Systems, 2014
- Optimization of Resource Provisioning Cost in Cloud ComputingIEEE Transactions on Services Computing, 2011