Distance-Adaptive Depth Camera–LiDAR Fusion for Object Distance Estimation on a Moving Tractor: A Field Evaluation Against RTK-GNSS
Open Access
- 12 November 2026
- journal article
- research article
- Published by MDPI AG in Agriculture
- Vol. 16 (22) , 2484
Abstract
Agricultural machinery has extensive blind zones, and reliable proximity alerts need distance information that no single sensor provides across the working range. We fused a depth camera and a 16-channel LiDAR by distance-adaptive inverse-variance weighting, with weights derived from nominal, specification-based error models that cross at 3.87 m. YOLO11m, trained on five classes, detected objects, and the pipeline ran at 26 frames per second on an edge computing platform. Distances to Person and Tractor targets were evaluated against real-time kinematic GNSS in 2521 samples from front and rear tractor approaches at nominal speeds of 3, 5, and 7 km/h. Fusion reduced the root mean square error (RMSE) to 0.211 m, 30.9% below that of the depth camera alone, with the largest reduction (35.8%) at 7–12 m and no change within 7 m. The LiDAR alone was more accurate (0.167 m) but valid in only 82.7% of frames. With both sensors valid, the fused RMSE (0.141 m) was lower than that of either sensor. For detected targets, alert levels agreed with the reference in 99.0% of frames, but a Person recall of 0.72 limits overall reliability. Target geometry and LiDAR resolution strongly affect the benefit of fusion, which may guide sensor selection for other agricultural machines.Keywords
Funding Information
- Korea Institute of Planning and Evaluation for Technology in Food, Agriculture, Forestry and Fisheries (RS-2025-02316456)
This publication has 24 references indexed in Scilit:
- Remote safety system for a robot tractor using a monocular camera and a YOLO-based methodComputers and Electronics in Agriculture, 2023
- Positioning and Attitude determination for Precision Agriculture Robots based on IMU and Two RTK GPSs Sensor FusionIFAC-PapersOnLine, 2022
- Agricultural robotics research applicable to poultry production: A reviewComputers and Electronics in Agriculture, 2020
- Evaluation of the performance of PoultryBot, an autonomous mobile robotic platform for poultry housesBiosystems Engineering, 2018
- Real-time probabilistic fusion of sparse 3D LIDAR and dense stereo2016
- Development of a crawler-type robot tractor using RTK-GPS and IMUEngineering in Agriculture, Environment and Food, 2014
- Comparison of Positional Accuracy betweenRTK and RTX GNSS Based on the Autonomous Agricultural Vehicles under Field ConditionsApplied Engineering in Agriculture, 2014
- Multilinear Supervised Neighborhood Embedding of a Local Descriptor Tensor for Scene/Object RecognitionIEEE Transactions on Image Processing, 2011
- Tractors and Rollover Protection in the United StatesJournal of Agromedicine, 2010
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000