Building Accurate and Interpretable Online Classifiers on Edge Devices
- 13 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 36 (8) , 1779-1796
Abstract
By integrating machine learning with edge devices, we can augment the capabilities of edge devices, such as IoT devices, household appliances, and wearable technologies. These edge devices generally operate on microcontrollers with inherently limited resources, such as constrained RAM capacity and limited computational power. Nonetheless, they often process data in a high-velocity stream fashion, exemplified by sequences of activities and statuses monitored by advanced industrial sensors. In practical scenarios, models must be interpretable to facilitate troubleshooting and behavior understanding. Implementing machine learning models on edge devices is valuable and challenging, striking a balance between model efficacy and resource constraint. To address this challenge, we introduce our novel Onfesk, which combines online learning algorithms with an innovative interpretable kernel. Specifically, our Onfesk trains an online classifier over the kernel's feature sketches. Benefiting from our specially designed modules, the kernel's feature sketches can be efficiently produced, and the memory requirements of the classifier can be significantly reduced. As a result, Onfesk delivers effective and efficient performance in environments with limited resources without compromising on model interpretability. Extensive experiments with diverse real-world datasets have shown that Onfesk outperforms state-of-the-art methods, achieving up to a 7.4% improvement in accuracy within identical memory constraints.Keywords
Funding Information
- National Natural Science Foundation of China (U22B2019, 62372362, 62272372)
This publication has 59 references indexed in Scilit:
- Online learning: A comprehensive surveyNeurocomputing, 2021
- Efficient image dataset classification difficulty estimation for predicting deep-learning accuracyThe Visual Computer, 2020
- Explainable Robotics in Human-Robot InteractionsProcedia Computer Science, 2020
- Simplifying ConvNets for Fast Learning2012
- Tracking the best hyperplane with a simple budget PerceptronMachine Learning, 2007
- Finding frequent items in data streamsTheoretical Computer Science, 2004
- Large Margin Classification Using the Perceptron AlgorithmMachine Learning, 1999
- Support-vector networksMachine Learning, 1995
- Some results on Tchebycheffian spline functionsJournal of Mathematical Analysis and Applications, 1971
- The Perceptron: A Model for Brain Functioning. IReviews of Modern Physics, 1962