WASP: Efficient Power Management Enabling Workload-Aware, Self-Powered AIoT Devices
- 3 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 35 (8) , 1400-1414
Abstract
The wide adoption of edge AI has heightened the demand for various battery-less and maintenance-free smart systems. Nevertheless, emerging Artificial Intelligence of Things (AIoT) are complex workloads showing increased power demand, diversified power usage patterns, and unique sensitivity to power management (PM) approaches. Existing AIoT devices cannot select the most appropriate PM tuning knob, and therefore they often make sub-optimal decisions. In addition, these PM solutions always assume traditional power regulation circuit which incurs non-negligible power loss and control overhead. This can greatly compromise the potential of AIoT efficiency. In this paper, we explore power management optimization for emerging self-powered AIoT devices. We propose WASP, a highly efficient power management scheme for workload-aware, self-powered AIoT devices. The novelty of WASP is two fold. First, it combines offline profiling and light-weight online control to select the most appropriate PM tuning knobs for the given DNN models. Second, it is well tailored to a reconfigurable voltage regulation module that can make the best use of the limited power budget. Our results show that WASP allows AIoT devices to accomplish 65.6% more inference tasks under a stringent power budget without any performance degradation compared with other existing approaches.Keywords
Funding Information
- National Natural Science Foundation of China (62122053)
- Shanghai Pujiang Program (23PJ1405100)
This publication has 49 references indexed in Scilit:
- A future location prediction method based on lightweight LSTM with hyperparamater optimizationScientific Reports, 2023
- AI-based Abstractive Text Summarization towards AIoT and Edge ComputingInternet Technology Letters, 2022
- TOD: Transprecise Object Detection to Maximise Real-Time Accuracy on the Edge2021
- Intermittent Inference with Nonuniformly Compressed Multi-Exit Neural Network for Energy Harvesting Powered Devices2020
- YOLO v3-Tiny: Object Detection and Recognition using one stage improved model2020
- ResiRCA: A Resilient Energy Harvesting ReRAM Crossbar-Based Accelerator for Intelligent Embedded Processors2020
- AMC: AutoML for Model Compression and Acceleration on Mobile Devices2018
- MobileNetV2: Inverted Residuals and Linear Bottlenecks2018
- UberNet: Training a Universal Convolutional Neural Network for Low-, Mid-, and High-Level Vision Using Diverse Datasets and Limited Memory2017
- XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks2016