Spatial Location of Sugarcane Node for Binocular Vision-Based Harvesting Robots Based on Improved YOLOv4
Open Access
- 17 March 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (6) , 3088
Abstract
Spatial location of sugarcane nodes using robots in agricultural conditions is a challenge in modern precision agriculture owing to the complex form of the sugarcane node when wrapped with leaves and the high computational demand. To solve these problems, a new binocular location method based on the improved YOLOv4 was proposed in this paper. First, the YOLOv4 deep learning algorithm was improved by the Channel Pruning Technology in network slimming, so as to ensure the high recognition accuracy of the deep learning algorithm and to facilitate transplantation to embedded chips. Secondly, the SIFT feature points were optimised by the RANSAC algorithm and epipolar constraint, which greatly reduced the mismatching problem caused by the similarity between stem nodes and sugarcane leaves. Finally, by using the optimised matching point to solve the homography transformation matrix, the space location of the sugarcane nodes was for the first time applied to the embedded chip in the complex field environment. The experimental results showed that the improved YOLOv4 algorithm reduced the model size, parameters and FLOPs by about 89.1%, while the average precision (AP) of stem node identification only dropped by 0.1% (from 94.5% to 94.4%). Compared with other deep learning algorithms, the improved YOLOv4 algorithm also has great advantages. Specifically, the improved algorithm was 1.3% and 0.3% higher than SSD and YOLOv3 in average precision (AP). In terms of parameters, FLOPs and model size, the improved YOLOv4 algorithm was only about 1/3 of SSD and 1/10 of YOLOv3. At the same time, the average locational error of the stem node in the Z direction was only 1.88 mm, which totally meets the demand of sugarcane harvesting robots in the next stage.Keywords
Funding Information
- National Natural Science Foundation of China (No. 51965004)
This publication has 22 references indexed in Scilit:
- Sugarcane node recognition technology based on wavelet analysisComputers and Electronics in Agriculture, 2019
- Visual positioning technology of picking robots for dynamic litchi clusters with disturbanceComputers and Electronics in Agriculture, 2018
- Analysis on Location Accuracy for the Binocular Stereo Vision SystemIEEE Photonics Journal, 2017
- Learning Efficient Convolutional Networks through Network Slimming2017
- Design, integration, and field evaluation of a robotic apple harvesterJournal of Field Robotics, 2017
- Vision-based extraction of spatial information in grape clusters for harvesting robotsBiosystems Engineering, 2016
- Computer vision recognition of stem and calyx in apples using near-infrared linear-array structured light and 3D reconstructionBiosystems Engineering, 2015
- Calibration for stereo vision system based on phase matching and bundle adjustment algorithmOptics and Lasers in Engineering, 2015
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Random sample consensusCommunications of the ACM, 1981