Cross-Layer Resource Optimization for Ultra-Low-Power TinyML Inference on ARM Cortex-M Microcontrollers
Open Access
- 3 July 2026
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 15 (13) , 2918
Abstract
Running neural networks on battery-powered Internet of Things (IoT) sensor nodes is difficult because flash memory, SRAM, latency, and energy per inference are limited at the same time. Existing TinyML co-design methods usually improve model size or memory use, but runtime voltage–frequency control is often handled as a separate step. This separation limits energy saving because the power policy does not use the layer-wise compute profile of the final compressed model. We propose the Cross-Layer Resource Optimizer (CLRO), a three-stage resource optimization pipeline for TinyML inference on an ARM Cortex-M7 target. The first stage, Mixed-Precision Aware Pruning and Distillation (MPAD), assigns per-layer bit widths and pruning ratios using calibration-set sensitivity scores. The second stage, consisting of the Activation Lifetime-Aware Tensor Scheduler (ALTS), uses the compressed graph to find an execution order that reduces peak live static random-access memory (SRAM). The third stage, Reinforcement Learning-Based Dynamic Voltage and Frequency Scaling (DVFS-RL), trains a tabular Q-learning policy from the multiply–accumulate (MAC) utilization profile of the compressed and scheduled model. The learned voltage–frequency policy is stored as a small flash lookup table, so it adds no runtime decision cost during inference. We evaluate the CLRO on all four MLPerf Tiny tasks using an STM32H743ZI microcontroller with 512 kB SRAM and 2 MB flash. The CLRO reaches 91.7% image classification accuracy, 95.4% keyword-spotting accuracy, 89.6% visual wake words accuracy, and 0.913 anomaly detection AUC. The final deployment uses 198 kB flash and 174 kB peak SRAM, with 387 μJ energy per inference and 38 ms latency. Compared with the MCUNet baseline, the CLRO reduces energy by 58.1% and peak SRAM by 39% while keeping the same accuracy level.Keywords
Funding Information
- Northern Border University (NBU-FFR-2026-2466-06)
This publication has 14 references indexed in Scilit:
- Deploying TinyML for energy-efficient object detection and communication in low-power edge AI systemsScientific Reports, 2025
- Federated learning and TinyML on IoT edge devices: Challenges, advances, and future directionsICT Express, 2025
- Reinforcement Learning-Based Dynamic Voltage and Frequency Scaling for Energy-Efficient Computing2024
- Dynamic Voltage and Frequency Scaling as a Method for Reducing Energy Consumption in Ultra-Low-Power Embedded SystemsElectronics, 2024
- A Machine Learning-Oriented Survey on Tiny Machine LearningIEEE Access, 2024
- DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative InferenceIEEE Transactions on Mobile Computing, 2024
- A Comprehensive Survey on TinyMLIEEE Access, 2023
- A green, secure, and deep intelligent method for dynamic IoT-edge-cloud offloading scenariosSustainable Computing: Informatics and Systems, 2023
- HAQ: Hardware-Aware Automated Quantization With Mixed Precision2019
- Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference2018