Deep Neural Network Compression for Plant Disease Recognition
Open Access
- 23 September 2021
- Vol. 13 (10) , 1769
Abstract
Deep neural networks (DNNs) have become the de facto standard for image recognition tasks, and their applications with respect to plant diseases have also obtained remarkable results. However, the large number of parameters and high computational complexities of these network models make them difficult to deploy on farms in remote areas. In this paper, focusing on the problems of resource constraints and plant diseases, we propose a DNN-based compression method. In order to reduce computational burden, this method uses lightweight fully connected layers to accelerate reasoning, pruning to remove redundant parameters and reduce multiply–accumulate operations, knowledge distillation instead of retraining to restore the lost accuracy, and then quantization to compress the size of the model further. After compressing the mainstream VGGNet and AlexNet models, the compressed versions are applied to the Plant Village dataset of plant disease images, and a performance comparison of the models before and after compression is obtained to verify the proposed method. The results show that the model can be compressed to 0.04 Mb with an accuracy of 97.09%. This experiment also proves the effectiveness of knowledge distillation during the pruning process, and compressed models are more efficient than prevalent lightweight models.Keywords
Funding Information
- Anhui Provincial Key Research and Development Plan (1804a07020108,201904a06020056,202104a06020012)
- Independent Project of Anhui Key Laboratory of Smart Agricultural Technology and Equipment (APKLSATE2019X001)
- Ministry of Agriculture Agricultural Internet of Things Technology Integration and Application Key Laboratory Open Fund in 2016 (2016KL05)
- Major Science and Technology Special Plan of Anhui Province in 2017 (17030701049)
- Major Project of Natural Science Research in Universities of Anhui Province (KJ2019ZD20)
This publication has 31 references indexed in Scilit:
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Deep Count: Fruit Counting Based on Deep Simulated LearningSensors, 2017
- Mixtures of Lightweight Deep Convolutional Neural Networks: Applied to Agricultural RoboticsIEEE Robotics and Automation Letters, 2017
- Using Deep Learning for Image-Based Plant Disease DetectionFrontiers in Plant Science, 2016
- EIEACM SIGARCH Computer Architecture News, 2016
- Guiding the Long-Short Term Memory Model for Image Caption Generation2015
- Fast R-CNN2015
- Learning Deconvolution Network for Semantic Segmentation2015
- Deep learningNature, 2015
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998