Advancement and Field Evaluation of a Dual-arm Apple Harvesting Robot
Preprint
Abstract
Apples are among the most widely consumed fruits worldwide. Currently, apple harvesting fully relies on manual labor, which is costly, drudging, and hazardous to workers. Hence, robotic harvesting has attracted increasing attention in recent years. However, existing systems still fall short in terms of performance, effectiveness, and reliability for complex orchard environments. In this work, we present the development and evaluation of a dual-arm harvesting robot. The system integrates a ToF camera, two 4DOF robotic arms, a centralized vacuum system, and a post-harvest handling module. During harvesting, suction force is dynamically assigned to either arm via the vacuum system, enabling efficient apple detachment while reducing power consumption and noise. Compared to our previous design, we incorporated a platform movement mechanism that enables both in-out and up-down adjustments, enhancing the robot's dexterity and adaptability to varying canopy structures. On the algorithmic side, we developed a robust apple localization pipeline that combines a foundation-model-based detector, segmentation, and clustering-based depth estimation, which improves performance in orchards. Additionally, pressure sensors were integrated into the system, and a novel dual-arm coordination strategy was introduced to respond to harvest failures based on sensor feedback, further improving picking efficiency. Field demos were conducted in two commercial orchards in MI, USA, with different canopy structures. The system achieved success rates of 0.807 and 0.797, with an average picking cycle time of 5.97s. The proposed strategy reduced harvest time by 28% compared to a single-arm baseline. The dual-arm harvesting robot enhances the reliability and efficiency of apple picking. With further advancements, the system holds strong potential for autonomous operation and commercialization for the apple industry.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- An automated apple harvesting robot—From system design to field evaluationJournal of Field Robotics, 2023
- Towards autonomous selective harvesting: A review of robot perception, robot design, motion planning and controlJournal of Field Robotics, 2023
- Modular autonomous strawberry picking robotic systemJournal of Field Robotics, 2023
- Mobile robotics platform for strawberry sensing and harvesting within precision indoor farming systemsJournal of Field Robotics, 2023
- Development, integration, and field evaluation of an autonomous citrus‐harvesting robotJournal of Field Robotics, 2023
- Intelligent robots for fruit harvesting: recent developments and future challengesPrecision Agriculture, 2022
- Design and evaluation of a modular robotic plum harvesting system utilizing soft componentsJournal of Field Robotics, 2020
- Development of a sweet pepper harvesting robotJournal of Field Robotics, 2020
- An autonomous strawberry‐harvesting robot: Design, development, integration, and field evaluationJournal of Field Robotics, 2019
- Design, integration, and field evaluation of a robotic apple harvesterJournal of Field Robotics, 2017