TreeNet Based Fast Task Decomposition for Resource-Constrained Edge Intelligence
- 29 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. PP (3) , 1-13
Abstract
Edge intelligence is an emerging technology that integrates edge computing and deep learning to bring AI to the network’s edge. It has gained wide attention for its lower network latency and better privacy preservation abilities. However, the inference of deep neural networks is computationally demanding and results in poor real-time performance, making it challenging for resource-constrained edge devices. In this paper, we propose a hierarchical deep learning model based on TreeNet to reduce the computational cost for edge devices. Based on the similarity of the classification categories, we decompose a given task into disjoint sub-tasks to reduce the complexity of the required model. Then a lightweight binary classifier is proposed for evaluating the sub-task inference result. If the inference result of a sub-task is unreliable, our system will forward the input samples to the cloud server for further processing. We also proposed a new strategy for finding and sharing common features across sub-tasks to improve training speed and accuracy. The experimental results on several popular datasets demonstrate the effectiveness of our approach in speeding up inferences while processing most of the input data with a low error rate.Keywords
This publication has 34 references indexed in Scilit:
- Confusion Graph: Detecting Confusion Communities in Large Scale Image Classification2017
- Adversarial Discriminative Domain Adaptation2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Neurosurgeon2017
- BranchyNet: Fast inference via early exiting from deep neural networks2016
- Edge Computing: Vision and ChallengesIEEE Internet of Things Journal, 2016
- Deep Residual Learning for Image Recognition2016
- Big/little deep neural network for ultra low power inference2015
- Mixture of experts: a literature surveyArtificial Intelligence Review, 2012
- Fast unfolding of communities in large networksJournal of Statistical Mechanics: Theory and Experiment, 2008