Leaf disease image retrieval with object detection and deep metric learning
Authors:
Open Access
- 13 September 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Plant Science
- Vol. 13, 963302
Abstract
Rapid identification of plant diseases is essential for effective mitigation and control of their influence on plants. For plant disease automatic identification, classification of plant leaf images based on deep learning algorithms is currently the most accurate and popular method. Existing methods rely on the collection of large amounts of image annotation data and cannot flexibly adjust recognition categories, whereas we develop a new image retrieval system for automated detection, localization, and identification of individual leaf disease in an open setting, namely, where newly added disease types can be identified without retraining. In this paper, we first optimize the YOLOv5 algorithm, enhancing recognition ability in small objects, which helps to extract leaf objects more accurately; secondly, integrating classification recognition with metric learning, jointly learning categorizing images and similarity measurements, thus, capitalizing on prediction ability of available image classification models; and finally, constructing an efficient and nimble image retrieval system to quickly determine leaf disease type. We demonstrate detailed experimental results on three publicly available leaf disease datasets and prove the effectiveness of our system. This work lays the groundwork for promoting disease surveillance of plants applicable to intelligent agriculture and to crop research such as nutrition diagnosis, health status surveillance, and more.Keywords
Funding Information
- Doctorate Fellowship Foundation of Nanjing Forestry University (163010550)
- Priority Academic Program Development of Jiangsu Higher Education Institutions
This publication has 28 references indexed in Scilit:
- Deep learning for classification and severity estimation of coffee leaf biotic stressComputers and Electronics in Agriculture, 2020
- Depthwise Convolution Is All You Need for Learning Multiple Visual DomainsProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Maize leaf disease classification using deep convolutional neural networksNeural Computing and Applications, 2019
- Deep Convolutional Hashing for Low-Dimensional Binary Embedding of Histopathological ImagesIEEE Journal of Biomedical and Health Informatics, 2018
- VISIR2018
- Towards Open Set Deep Networks2016
- Discriminative Learning of Deep Convolutional Feature Point Descriptors2015
- Learning Fine-Grained Image Similarity with Deep Ranking2014
- Leafsnap: A Computer Vision System for Automatic Plant Species Identification2012
- A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network2007