Fruit recognition method for a harvesting robot with RGB-D cameras
Authors:
Open Access
- 28 May 2022
- journal article
- research article
- Published by Springer Nature in ROBOMECH Journal
- Vol. 9 (1) , 1-10
Abstract
In this study, we present a recognition method for a fruit-harvesting robot to automate the harvesting of pears and apples on joint V-shaped trellis. It is necessary to recognize the three-dimensional position of the harvesting target for harvesting by the fruit-harvesting robot to insert its end-effector. However, the RGB-D (red, green, blue and depth) camera on the harvesting robot has a problem in that the point cloud obtained in outdoor environments can be inaccurate. Therefore, in this study, we propose an effective method for the harvesting robot to recognize fruits using not only three-dimensional information obtained from the RGB-D camera but also two-dimensional images and information from the camera. Furthermore, we report a method for determining the ripeness of pears using the information on fruit detection. Through experiments, we confirmed that the proposed method satisfies the accuracy required for a harvesting robot to continuously harvest fruits.Keywords
All Related Versions
Funding Information
- Bio-oriented Technology Research Advancement Institution (16930531)
This publication has 19 references indexed in Scilit:
- Controlled Lighting and Illumination-Independent Target Detection for Real-Time Cost-Efficient Applications. The Case Study of Sweet Pepper Robotic HarvestingSensors, 2019
- Apple Fruit Recognition Algorithm Based on Multi-Spectral Dynamic Image AnalysisSensors, 2019
- Guava Detection and Pose Estimation Using a Low-Cost RGB-D Sensor in the FieldSensors, 2019
- Mask R-CNNIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Fast Detection of Tomato Peduncle Using Point Cloud with a Harvesting RobotJournal of Robotics and Mechatronics, 2018
- Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit pickingComputers and Electronics in Agriculture, 2017
- DeepFruits: A Fruit Detection System Using Deep Neural NetworksSensors, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Detection of red and bicoloured apples on tree with an RGB-D cameraBiosystems Engineering, 2016
- Random sample consensusCommunications of the ACM, 1981