Towards Practical 2D Grapevine Bud Detection with Fully Convolutional Networks
Preprint
Abstract
In Viticulture, visual inspection of the plant is a necessary task for measuring relevant variables. In many cases, these visual inspections are susceptible to automation through computer vision methods. Bud detection is one such visual task, central for the measurement of important variables such as: measurement of bud sunlight exposure, autonomous pruning, bud counting, type-of-bud classification, bud geometric characterization, internode length, bud area, and bud development stage, among others. This paper presents a computer method for grapevine bud detection based on a Fully Convolutional Networks MobileNet architecture (FCN-MN). To validate its performance, this architecture was compared in the detection task with a strong method for bud detection, Scanning Windows (SW) based on a patch classifier, showing improvements over three aspects of detection: segmentation, correspondence identification and localization. The best version of FCN-MN showed a detection F1-measure of $88.6\%$ (for true positives defined as detected components whose intersection-over-union with the true bud is above $0.5$), and false positives that are small and near the true bud. Splits -- false positives overlapping the true bud -- showed a mean segmentation precision of $89.3\% (21.7)$, while false alarms -- false positives not overlapping the true bud -- showed a mean pixel area of only $8\%$ the area of a true bud, and a distance (between mass centers) of $1.1$ true bud diameters. The paper concludes by discussing how these results for FCN-MN would produce sufficiently accurate measurements of bud variables such as bud number, bud area, and internode length, suggesting a good performance in a practical setup.
Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Grape detection, segmentation, and tracking using deep neural networks and three-dimensional associationComputers and Electronics in Agriculture, 2020
- An adaptable approach to automated visual detection of plant organs with applications in grapevine breedingBiosystems Engineering, 2019
- Research on Stalk Crops Internodes and Buds Identification based on Computer VisionIOP Conference Series: Materials Science and Engineering, 2018
- A survey on deep learning techniques for image and video semantic segmentationApplied Soft Computing, 2018
- Grapevine buds detection and localization in 3D space based on Structure from Motion and 2D image classificationComputers in Industry, 2018
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- Image classification for detection of winter grapevine buds in natural conditions using scale-invariant features transform, bag of features and support vector machinesComputers and Electronics in Agriculture, 2017
- Grape clusters and foliage detection algorithms for autonomous selective vineyard sprayerIntelligent Service Robotics, 2010
- Lessons from nearly 20 years of Precision Agriculture research, development, and adoption as a guide to its appropriate applicationCrop & Pasture Science, 2009
- Multiple View Geometry in Computer Vision2004