Resource Usage Cost Optimization in Cloud Computing Using Machine Learning
- 11 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cloud Computing
- Vol. 10 (3) , 2079-2089
Abstract
Cloud computing is gaining popularity among small and medium-sized enterprises. The cost of cloud resources plays a significant role for these companies and this is why cloud resource optimization has become a very important issue. Numerous methods have been proposed to optimize cloud computing resources according to actual demand and to reduce the cost of cloud services. Such approaches mostly focus on a single factor (i.e. compute power) optimization, but this can yield unsatisfactory results in real-world cloud workloads which are multi-factor, dynamic and irregular. This paper presents a novel approach which uses anomaly detection, machine learning and particle swarm optimization to achieve a cost-optimal cloud resource configuration. It is a complete solution which works in a closed loop without the need for external supervision or initialization, builds knowledge about the usage patterns of the system being optimized and filters out anomalous situations on the fly. Our solution can adapt to changes in both system load and the cloud provider's pricing plan. It was tested in Microsoft's cloud environment Azure using data collected from a real-life system. Experiments demonstrate that over a period of 10 months, a cost reduction of 85% was achieved.Keywords
Funding Information
- Polish Ministry of Science and Higher Education
This publication has 41 references indexed in Scilit:
- A coral-reefs and Game Theory-based approach for optimizing elastic cloud resource allocationFuture Generation Computer Systems, 2018
- A novel agent based autonomous and service composition framework for cost optimization of resource provisioning in cloud computingJournal of King Saud University Computer and Information Sciences, 2017
- On Global Electricity Usage of Communication Technology: Trends to 2030Challenges, 2015
- A Review of Auto-scaling Techniques for Elastic Applications in Cloud EnvironmentsJournal of Grid Computing, 2014
- On the Integration of Cloud Computing and Internet of Things2014
- Virtual Machine Resource Allocation in Cloud Computing via Multi-Agent Fuzzy Control2013
- Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service CloudsFuture Generation Computer Systems, 2013
- Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised LearningFoundations and Trends in Computer Graphics and Vision, 2012
- A game-theoretic method of fair resource allocation for cloud computing servicesThe Journal of Supercomputing, 2009
- Neural Networks1996