Adaptive Machine Learning-Based Proactive Thermal Management for NoC Systems
Authors:
- 15 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 31 (8) , 1114-1127
Abstract
Because of the high-complex interconnection in contemporary multicore systems, the network-on-chip (NoC) technology has been proven as an efficient way to solve the communication problem in multicore systems. However, the thermal problem becomes the main design challenge in the current NoC systems due to the high-diverse workload distribution and large power density. Therefore, proactive dynamic thermal management (PDTM) is employed as an efficient way to control the system temperature. Based on the predicted temperature information, the PDTM can control the system temperature in advance to reduce the performance impact during the temperature control period. However, conventional temperature prediction models are usually built based on specific physical parameters, which are usually temperature-sensitive. Consequently, the current temperature prediction models still result in significant temperature prediction errors. To solve this problem, a novel adaptive machine learning (ML)-based PDTM is proposed in this work. The adaptive ML-based PDTM first uses an adaptive single layer perceptron (ASLP), which is composed of a single-neuron operation and a least mean square (LMS) adaptive filter technology, to precisely predict the future temperature. Afterward, the proposed adaptive reinforcement learning (RL) is used to find the proper throttling ratio to control the system temperature. In this way, the proposed adaptive ML-based PDTM can adapt to the hyperplane of the temperature behavior of the NoC system and provide a proper temperature control strategy at runtime. Compared with related works, the proposed approach reduces average temperature prediction error by 0.2%–78.0% and improves the system performance by 2.4%–43.0% with smaller hardware overhead.Keywords
Funding Information
- Ministry of Science and Technology, Taiwan (NSTC 110-2221-E-110-026-MY3, NSTC 111-2628-E-110-011-MY3)
This publication has 29 references indexed in Scilit:
- Distributed Reinforcement Learning for Power Limited Many-Core System Performance Optimization2015
- LMS-based adaptive temperature prediction scheme for proactive thermal-aware three-dimensional Network-on-Chip systems2014
- Dynamic thread mapping for high-performance, power-efficient heterogeneous many-core systems2013
- Transport-layer-assisted routing for runtime thermal management of 3D NoC systemsACM Transactions on Embedded Computing Systems, 2013
- 95 % Confidence Interval: A Misunderstood Statistical ToolIndian Journal of Surgery, 2012
- Reactive speed control in temperature-constrained real-time systemsReal-Time Systems, 2007
- Reinforcement Learning in Continuous Action Spaces2007
- Thermal Modeling, Characterization and Management of On-Chip Networks2005
- The odd-even turn model for adaptive routingIEEE Transactions on Parallel and Distributed Systems, 2000
- Q-learningMachine Learning, 1992