Optimizing Energy Efficiency for Data Center via Parameterized Deep Reinforcement Learning
- 20 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. 16 (2) , 1310-1323
Abstract
The rapid advancements in cloud computing, Big Data and their related applications have led to a skyrocketing increase in data center energy consumption year by year. The prior approaches for improving data center energy efficiency mostly suffer from high system dynamics or the complexity of data centers. In this paper, we propose an optimization framework based on deep reinforcement learning, named DeepEE, to jointly optimize energy consumption from the perspectives of task scheduling and cooling control. In DeepEE, a PArameterized action space based Deep Q-Network (PADQN) algorithm is proposed to tackle the hybrid action space problem. Then, a dynamic time factor mechanism for adjusting cooling control interval is introduced into PADQN (PADQN-D) to achieve more accurate and efficient coordination of IT and cooling subsystems. Finally, in order to train and evaluate the proposed algorithms safely and quickly, a simulation platform is built to model the dynamics of IT and cooling subsystems. Extensive real-trace based experiments illustrate that: 1) the proposed PADQN algorithm can save up to 15% and 10% energy consumption compared with the baseline siloed and joint optimization approaches respectively; 2) the proposed PADQN-D algorithm with dynamic cooling control interval can better adapt to the change of IT workload; 3) our proposed algorithms achieve more stable performance gain in terms of power consumption by adopting the parameterized action space.Keywords
Funding Information
- National Research Foundation Singapore
- Energy Research Test-Bed and Industry Partnership Funding Initiative
- National Research Foundation (NRF2020NRF-CG001-027)
- NTUitive Gap
- National Natural Science Foundation of China (62003067, 61971457)
- National Key Research and Development Program of China (2021YFC3300200)
- Education Department Foundation of Jiangxi Province (GJJ211111)
This publication has 33 references indexed in Scilit:
- Communication and cooling aware job allocation in data centers for communication-intensive workloadsJournal of Parallel and Distributed Computing, 2016
- Towards Joint Optimization Over ICT and Cooling Systems in Data Centre: A SurveyIEEE Communications Surveys & Tutorials, 2016
- TIGER: Thermal-Aware File Assignment in Storage ClustersIEEE Transactions on Parallel and Distributed Systems, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Thermal-Aware Scheduling of Batch Jobs in Geographically Distributed Data CentersIEEE Transactions on Cloud Computing, 2014
- Cooling-aware workload placement with performance constraintsPerformance Evaluation, 2011
- Integrating cooling awareness with thermal aware workload placement for HPC data centersSustainable Computing: Informatics and Systems, 2011
- Model-driven coordinated management of data centersComputer Networks, 2010
- Spatio-temporal thermal-aware job scheduling to minimize energy consumption in virtualized heterogeneous data centersComputer Networks, 2009
- Power provisioning for a warehouse-sized computerACM SIGARCH Computer Architecture News, 2007