HUNTER: AI based Holistic Resource Management for Sustainable Cloud Computing
Authors:
- Shreshth TuliSTShreshth Tuli
- Sukhpal Singh GillSukhpal Singh Gill
- Minxian XuMinxian Xu
- Peter GarraghanPGPeter Garraghan
- Rami BahsoonRBRami Bahsoon
- Schahram DustdarSchahram Dustdar
- Rizos SakellariouRSRizos Sakellariou
- Omer RanaOmer Rana
- Rajkumar BuyyaRBRajkumar Buyya
- Giuliano CasaleGCGiuliano Casale
- Nicholas R. JenningsNJNicholas R. Jennings
Preprint
Abstract
The worldwide adoption of cloud data centers (CDCs) has given rise to the ubiquitous demand for hosting application services on the cloud. Further, contemporary data-intensive industries have seen a sharp upsurge in the resource requirements of modern applications. This has led to the provisioning of an increased number of cloud servers, giving rise to higher energy consumption and, consequently, sustainability concerns. Traditional heuristics and reinforcement learning based algorithms for energy-efficient cloud resource management address the scalability and adaptability related challenges to a limited extent. Existing work often fails to capture dependencies across thermal characteristics of hosts, resource consumption of tasks and the corresponding scheduling decisions. This leads to poor scalability and an increase in the compute resource requirements, particularly in environments with non-stationary resource demands. To address these limitations, we propose an artificial intelligence (AI) based holistic resource management technique for sustainable cloud computing called HUNTER. The proposed model formulates the goal of optimizing energy efficiency in data centers as a multi-objective scheduling problem, considering three important models: energy, thermal and cooling. HUNTER utilizes a Gated Graph Convolution Network as a surrogate model for approximating the Quality of Service (QoS) for a system state and generating optimal scheduling decisions. Experiments on simulated and physical cloud environments using the CloudSim toolkit and the COSCO framework show that HUNTER outperforms state-of-the-art baselines in terms of energy consumption, SLA violation, scheduling time, cost and temperature by up to 12, 35, 43, 54 and 3 percent respectively.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Energy-efficient VM scheduling based on deep reinforcement learningFuture Generation Computer Systems, 2021
- Holistic thermal-aware workload management and infrastructure control for heterogeneous data centers using machine learningFuture Generation Computer Systems, 2021
- Energy-efficient scheduling of small cells in 5G: A meta-heuristic approachJournal of Network and Computer Applications, 2021
- Memory-aware resource management algorithm for low-energy cloud data centersFuture Generation Computer Systems, 2020
- IoTSim-SDWAN: A simulation framework for interconnecting distributed datacenters over Software-Defined Wide Area Network (SD-WAN)Journal of Parallel and Distributed Computing, 2020
- Joint data center cooling and workload management: A thermal-aware approachFuture Generation Computer Systems, 2020
- A Study on Research Trends of Technologies for Industry 4.0; 3D Printing, Artificial Intelligence, Big Data, Cloud Computing, and Internet of Things2018
- Toward holistic performance management in clouds: taxonomy, challenges and opportunitiesThe Journal of Supercomputing, 2018
- RETRACTED ARTICLE: Energy efficient scheduling for cloud data centers using heuristic based migrationCluster Computing, 2018
- Novel energy and SLA efficient resource management heuristics for consolidation of virtual machines in cloud data centersComputers and Electrical Engineering, 2015