Target Track Enhancement Based on Asynchronous Radar and Camera Fusion in Intelligent Driving System
- 12 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 24 (3) , 3131-3143
Abstract
In the domain of intelligent driving vehicles, radar and camera sensors play a crucial role, and their fusion has been widely acknowledged to enhance sensing range and accuracy. This paper delves into the challenge of asynchronous information fusion for object detection between radar and camera, taking into consideration different sampling frequencies of radar and camera. Initially, different state observation and prediction models for radar and camera are formulated, leading to the proposal of a comprehensive target tracking model. Subsequently, the matching and fusion process of detection results is undertaken, yielding an optimal estimation as the output of the sensor information fusion system. Furthermore, the paper introduces the intelligent vehicle sensor fusion task and describes the stepwise approach to sensor fusion in traffic scenarios, including coordinate transform, sensor data preprocessing, and target track. To validate the proposed sensor asynchronous fusion algorithm, a simulation experiment and a road test are conducted focusing on interaction between ego and environment vehicles. The simulation results underscore the effectiveness of the algorithm, with an average lateral error reduction of 32% and an average longitudinal error reduction of 63%. Road test shows that effective fusion can expand the detection range of sensor system and improve the detection performance.Keywords
This publication has 34 references indexed in Scilit:
- Study on Target Tracking Based on Vision and Radar Sensor FusionSAE International Journal of Advances and Current Practices in Mobility, 2018
- Vehicle Target Recognition System Based on Fuzzy Control for Millimeter Wave Radar2017
- Hierarchical Fusion Estimation for Clustered Asynchronous Sensor NetworksIEEE Transactions on Automatic Control, 2015
- PTracking: Distributed Multi-Agent Multi-Object Tracking through Multi-Clustered Particle Filtering2015
- Multisensor data fusion: A review of the state-of-the-artInformation Fusion, 2013
- Frontal object perception using radar and mono-vision2012
- Track-to-track fusion with asynchronous sensors and out-of-sequence tracks using information matrix fusion for advanced driver assistance systems2012
- Multisensor Fusion and Integration: Theories, Applications, and its PerspectivesIEEE Sensors Journal, 2011
- Theory of distributed estimation using multiple asynchronous sensorsIEEE Transactions on Aerospace and Electronic Systems, 2005
- On the track-to-track correlation problemIEEE Transactions on Automatic Control, 1981