Maturity Recognition and Fruit Counting for Sweet Peppers in Greenhouses Using Deep Learning Neural Networks
Open Access
- 20 February 2024
- journal article
- research article
- Published by MDPI AG in Agriculture
- Vol. 14 (3) , 331
Abstract
This study presents an approach to address the challenges of recognizing the maturity stage and counting sweet peppers of varying colors (green, yellow, orange, and red) within greenhouse environments. The methodology leverages the YOLOv5 model for real-time object detection, classification, and localization, coupled with the DeepSORT algorithm for efficient tracking. The system was successfully implemented to monitor sweet pepper production, and some challenges related to this environment, namely occlusions and the presence of leaves and branches, were effectively overcome. We evaluated our algorithm using real-world data collected in a sweet pepper greenhouse. A dataset comprising 1863 images was meticulously compiled to enhance the study, incorporating diverse sweet pepper varieties and maturity levels. Additionally, the study emphasized the role of confidence levels in object recognition, achieving a confidence level of 0.973. Furthermore, the DeepSORT algorithm was successfully applied for counting sweet peppers, demonstrating an accuracy level of 85.7% in two simulated environments under challenging conditions, such as varied lighting and inaccuracies in maturity level assessment.Keywords
This publication has 34 references indexed in Scilit:
- Deep learning – Method overview and review of use for fruit detection and yield estimationComputers and Electronics in Agriculture, 2019
- A Mature-Tomato Detection Algorithm Using Machine Learning and Color AnalysisSensors, 2019
- Extending IOU Based Multi-Object Tracking by Visual Information2018
- Deep learning in agriculture: A surveyComputers and Electronics in Agriculture, 2018
- A Survey on 3D Cameras: Metrological Comparison of Time-of-Flight, Structured-Light and Active Stereoscopy Technologies2018
- Simple online and realtime tracking with a deep association metric2017
- Detecting tomatoes in greenhouse scenes by combining AdaBoost classifier and colour analysisBiosystems Engineering, 2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Applications of computer vision techniques in the agriculture and food industry: a reviewEuropean Food Research and Technology, 2012
- Compilation of an accumulated temperature database for use in an environmental information systemAgricultural and Forest Meteorology, 1993