A Method of Deep Learning Model Optimization for Image Classification on Edge Device
Open Access
Abstract
Due to the recent increasing utilization of deep learning models on edge devices, the industry demand for Deep Learning Model Optimization (DLMO) is also increasing. This paper derives a usage strategy of DLMO based on the performance evaluation through light convolution, quantization, pruning techniques and knowledge distillation, known to be excellent in reducing memory size and operation delay with a minimal accuracy drop. Through experiments regarding image classification, we derive possible and optimal strategies to apply deep learning into Internet of Things (IoT) or tiny embedded devices. In particular, strategies for DLMO technology most suitable for each on-device Artificial Intelligence (AI) service are proposed in terms of performance factors. In this paper, we suggest a possible solution of the most rational algorithm under very limited resource environments by utilizing mature deep learning methodologies.Keywords
Funding Information
- Korea Government (MSIT) (2021-0-00852, 2019R1F1A1062878)
- Institute of Information and Communications Technology Planning and Evaluation (2021-0-00852, 2019R1F1A1062878)
This publication has 31 references indexed in Scilit:
- Knowledge Distillation: A SurveyInternational Journal of Computer Vision, 2021
- Heterogeneous Knowledge Distillation Using Information Flow Modeling2020
- Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive SurveyProceedings of the IEEE, 2020
- Self-Knowledge Distillation in Natural Language Processing2019
- A Survey on Edge Computing Systems and ToolsProceedings of the IEEE, 2019
- Learning Deep Representations with Probabilistic Knowledge Transfer2018
- ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices2018
- Deep Mutual Learning2018
- A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning2017
- Aggregated Residual Transformations for Deep Neural Networks2017