Reinforcement Learning-Based Dynamic Voltage and Frequency Scaling for Energy-Efficient Computing
Authors:
- 26 April 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
The surge in demand for energy-efficient computing has spurred the exploration of cutting-edge techniques to optimize power consumption in modern computing systems. Though the traditional implementation of Dynamic Voltage and Frequency Scaling (DVFS) has proven effective, their traditional implementations lack adaptability, limiting their ability to fully exploit dynamic workload variations. This research presents an innovative solution by integrating proposed Reinforcement Learning (RL) algorithms into DVFS, addressing the limitations of conventional methods. The proposed RL algorithm employs Q-Iearning, a model-free RL technique, to iteratively learn the optimal policy for adjusting CPU voltage and frequency. Our customized algorithm enables autonomous real-time adjustments of voltage and frequency levels, showcasing a remarkable 20% power saving compared to conventional DVFS. The model's adaptability is evident in its capacity to achieve optimal configurations across diverse workloads, emphasizing RL's potential for enhancing energy efficiency in computing systems. As energy efficiency gains paramount importance, this research underscores the pivotal role of RL, in achieving sustainable and optimal performance in computing systems.Keywords
This publication has 12 references indexed in Scilit:
- A comprehensive survey of energy-efficient computing to enable sustainable massive IoT networksAlexandria Engineering Journal, 2024
- Reinforcement Learning Based Offloading for Realtime Applications in Mobile Edge Computing2020
- A survey study on virtual machine migration and server consolidation techniques in DVFS-enabled cloud datacenter: Taxonomy and challengesJournal of King Saud University Computer and Information Sciences, 2020
- Autonomous Power Management With Double-QReinforcement Learning MethodIEEE Transactions on Industrial Informatics, 2019
- On the feasibility of SISO control-theoretic DVFS for power capping in CMPsMicroprocessors and Microsystems, 2018
- Machine Learning for Power, Energy, and Thermal Management on Multicore Processors: A SurveyIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- Dynamic Voltage and Frequency Scaling in NoCs with Supervised and Reinforcement Learning TechniquesIEEE Transactions on Computers, 2018
- LEAD: Learning-enabled Energy-Aware Dynamic Voltage/frequency scaling in NoCs2018
- Toward a Smart Cloud: A Review of Fault-Tolerance Methods in Cloud SystemsIEEE Transactions on Services Computing, 2018
- Double-Q Learning-Based DVFS for Multi-core Real-Time Systems2017