Exploiting Approximation for Run-time Resource Management of Embedded HMPs
Open Access
- 4 April 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 24 (3) , 1-30
Abstract
Run-time resource management (RTM) of multi-programmed workloads on heterogeneous multi-core platforms is challenging due to (i) fixed power budget of the device, (ii) variable performance requirements of the workloads, and (iii) unknown arrival of the applications. Existing RTM solutions lack power-performance coordination, resulting in performance degradation during power actuation or power violations during performance provisioning. Exploiting inherent error-resilience of the applications can address the performance loss incurred in power actuation, by combining run-time approximation with traditional power knobs (including Dynamic Voltage/Frequency Scaling, Task Migration, Degree of Parallelism, and CPU Quota ). In this work, we present an accuracy-aware resource management framework that jointly actuates run-time approximation and traditional power knobs for efficient power-performance management of multi-programmed and multi-threaded workloads running on heterogeneous mobile platforms. Our strategy configures the accuracy of the applications at run-time to exploit accuracy-performance trade-offs, by considering system-wide power-performance dynamics. We use heuristic estimation models to jointly enforce accuracy configuration and traditional power knobs settings at run-time. We evaluated our framework on real-world embedded mobile platforms, including Odroid XU3 and Asus Tinker Edge R boards to demonstrate the efficiency of our proposed approach across multiple workload scenarios. Our approach achieved 25% lower performance violations against the state-of-the-art run-time resource management policies at the cost of 2.2% accuracy loss across six applications.Keywords
Funding Information
- European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska Curie (956090 (APROPOS))
This publication has 15 references indexed in Scilit:
- Tango: Low Latency Multi-DNN Inference on Heterogeneous Edge Platforms2024
- Adaptive approximate computing in edge AI and IoT applications: A reviewJournal of Systems Architecture, 2024
- Adaptive Workload Distribution for Accuracy-aware DNN Inference on Collaborative Edge Platforms2024
- Approximation-Aware Task Deployment on Heterogeneous Multicore Platforms With DVFSIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2022
- Prepare: P owe r -Awar e A p proximate Re a l-time Task Scheduling for Ene r gy-Adaptiv e QoS MaximizationACM Transactions on Embedded Computing Systems, 2021
- Concurrent Application Bias Scheduling for Energy Efficiency of Heterogeneous Multi-Core PlatformsIEEE Transactions on Computers, 2021
- AdaMD: Adaptive Mapping and DVFS for Energy-Efficient Heterogeneous MulticoresIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2019
- Dynamic Resource Management of Heterogeneous Mobile Platforms via Imitation LearningIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2019
- Accuracy-Aware Power Management for Many-Core Systems Running Error-Resilient ApplicationsIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2017
- Power Density-Aware Resource Management for Heterogeneous Tiled MulticoresIEEE Transactions on Computers, 2016