Deep Learning-Based Segmentation of Intertwined Fruit Trees for Agricultural Tasks
Open Access
- 4 November 2023
- journal article
- research article
- Published by MDPI AG in Agriculture
- Vol. 13 (11) , 2097
Abstract
Fruit trees in orchards are typically placed at equal distances in rows; therefore, their branches are intertwined. The precise segmentation of a target tree in this situation is very important for many agricultural tasks, such as yield estimation, phenotyping, spraying, and pruning. However, our survey on tree segmentation revealed that no study has explicitly addressed this intertwining situation. This paper presents a novel dataset in which a precise tree region is labeled carefully by a human annotator by delineating the branches and trunk of a target apple tree. Because traditional rule-based image segmentation methods neglect semantic considerations, we employed cutting-edge deep learning models. Five recently pre-trained deep learning models for segmentation were modified to suit tree segmentation and were fine-tuned using our dataset. The experimental results show that YOLOv8 produces the best average precision (AP), 93.7 box AP@0.5:0.95 and 84.2 mask AP@0.5:0.95. We believe that our model can be successfully applied to various agricultural tasks.Keywords
Funding Information
- Rural Development Administration (PJ015618)
This publication has 51 references indexed in Scilit:
- Site-specific orchard sprayer equipped with machine vision for chemical usage managementComputers and Electronics in Agriculture, 2019
- Semantic mapping for orchard environments by merging two‐sides reconstructions of tree rowsJournal of Field Robotics, 2019
- In-field high throughput grapevine phenotyping with a consumer-grade depth cameraComputers and Electronics in Agriculture, 2019
- Branch detection for apple trees trained in fruiting wall architecture using depth features and Regions-Convolutional Neural Network (R-CNN)Computers and Electronics in Agriculture, 2018
- Mask R-CNNIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Tree-Stump Detection, Segmentation, Classification, and Measurement Using Unmanned Aerial Vehicle (UAV) ImageryForests, 2018
- An intelligent precision orchard pesticide spray technique based on the depth-of-field extraction algorithmComputers and Electronics in Agriculture, 2017
- Comparison of Tree Species Classifications at the Individual Tree Level by Combining ALS Data and RGB Images Using Different AlgorithmsRemote Sensing, 2016
- Deep Residual Learning for Image Recognition2016
- Evaluating Tree Detection and Segmentation Routines on Very High Resolution UAV LiDAR DataIEEE Transactions on Geoscience and Remote Sensing, 2014