Fruit recognition, task plan, and control for apple harvesting robots
Open Access
- 1 January 2024
- journal article
- research article
- Published by FapUNIFESP (SciELO) in Revista Brasileira de Engenharia Agrícola E Ambiental
- Vol. 28 (9) , e277280
Abstract
Intelligent apple-harvesting robots use a staggered distribution of branches and leaves during operation, causing problems such as slow motion planning, low operational efficiency, and high path cost for multi-degrees-of-freedom (DOF) harvesting manipulators. This study presents an autonomous apple-harvesting robotic arm-hand composite system that aims to improve the operational efficiency of intelligent harvesting in dwarf anvil-planted apple orchards. The machine vision system for fruit detection uses the deep learning convolutional neural network (CNN) YOLOv7 and RGB-D camera online detection coupling technology to rapidly recognise apples. The spatial depth information of the fruit area was then extracted from the aligned depth image for precise positioning. Coordinate transformation was used to obtain the coordinates of the fruit under the coordinate system of the manipulator. Based on the informed rapid-exploration random tree (Informed-RRT*) algorithm and path-planning model, the identified target apples were harvested without collision path planning. In an apple-harvesting test, the recognition accuracy of the visual system was 89.4%, and the average time to harvest a single apple was 9.69 s, which was 4.8% faster than the mainstream general harvesting technology. Moreover, the harvesting time for a single apple was reduced by 1.7%. Thus, the proposed system enabled accurate and efficient fruit harvesting.Keywords
This publication has 19 references indexed in Scilit:
- Leguminous seeds detection based on convolutional neural networks: Comparison of Faster R-CNN and YOLOv4 on a small custom datasetArtificial Intelligence in Agriculture, 2023
- Channel pruned YOLO V5s-based deep learning approach for rapid and accurate apple fruitlet detection before fruit thinningBiosystems Engineering, 2021
- Faster R–CNN–based apple detection in dense-foliage fruiting-wall trees using RGB and depth features for robotic harvestingBiosystems Engineering, 2020
- Determination of key canopy parameters for mass mechanical apple harvesting using supervised machine learning and principal component analysis (PCA)Biosystems Engineering, 2020
- An autonomous strawberry‐harvesting robot: Design, development, integration, and field evaluationJournal of Field Robotics, 2019
- Response of fruit yield, fruit quality, and water use efficiency to water deficits for apple trees under surge-root irrigation in the Loess Plateau of ChinaAgricultural Water Management, 2019
- A methodology of orchard architecture design for an optimal harvesting robotBiosystems Engineering, 2018
- Effect of fruit location on apple detachment with mechanical shakingBiosystems Engineering, 2017
- Design and control of an apple harvesting robotBiosystems Engineering, 2011
- Evaluation of a strawberry-harvesting robot in a field testBiosystems Engineering, 2010