3-D Objects Detection and Tracking Using Solid-State LiDAR and RGB Camera
- 1 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 23 (13) , 14795-14808
Abstract
Objects detection and tracking using 3D LiDAR has gained momentum lately while it has not been extensively applied, and the main challenge is that conventional mechanical LiDAR is expensive and it is difficult for single sensor to obtain good tracking performance over a long period of time. In this paper, we propose a multi-sensor fusion 3D objects detection and tracking framework using solid-state LiDAR and RGB camera. We use a low-cost solid-state LiDAR with irregular scan pattern and propose a universal clustering method which determines the searching radius by laser density and range. To improve the overall tracking performance, range and visual information are both utilized to associate 3D objects across different frames. We avoid introducing odometry errors into the system and use visual difference rather than estimated trajectory to distinguish between closely located objects. And we have designed a re-detection process to locate objects that were missed by the clustering algorithm. We evaluated the proposed method on five sequences captured by our ego-vehicle and three additional sequences from open-source datasets. Our results demonstrate that the adaptive searching radius enhances recall and the overall tracking performance is improved by fusing LiDAR and camera.Keywords
Funding Information
- National Natural Science Foundation of China (Grant No. 62073163, Grant No. 62103285, Grant No. 62203228)
- Fundamental Research Funds for the Central Universities (Grant No. NZ2020004)
This publication has 49 references indexed in Scilit:
- LOAM: Lidar Odometry and Mapping in Real-time2014
- Precision tracking with sparse 3D and dense color 2D data2013
- Pedestrian Detection and Tracking Using Three-dimensional LADAR DataThe International Journal of Robotics Research, 2010
- Object Detection and Tracking for Autonomous Navigation in Dynamic EnvironmentsThe International Journal of Robotics Research, 2010
- Model based vehicle detection and tracking for autonomous urban drivingAutonomous Robots, 2009
- Multi-Object Tracking Using Color, Texture and Motion2007
- Object trackingACM Computing Surveys, 2006
- Real-time multiple vehicle detection and tracking from a moving vehicleMachine Vision and Applications, 2000
- The Mahalanobis distanceChemometrics and Intelligent Laboratory Systems, 2000
- Data SplittingThe American Statistician, 1990