4D Radar-Camera Sensor Fusion for Robust Vehicle Pose Estimation in Foggy Environments
Open Access
- 21 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 16178-16188
Abstract
The integration of cameras and millimeter-wave radar into sensor fusion algorithms is essential to ensure robustness and cost effectiveness for vehicle pose estimation. Due to the low resolution of traditional radar, several studies have investigated 4D imaging radar, which provides range, Doppler, azimuth, and elevation information with high resolution. This paper presents a method for robustly estimating vehicle pose through 4D radar and camera fusion, utilizing the complementary characteristics of each sensor. Leveraging the single-view geometry of the detected vehicle bounding box, the lateral position is derived based on the camera images, and the yaw rate is calculated through feature matching between consecutive images. The high-resolution 4D radar data are used to estimate the heading angle and forward velocity of the target vehicle by leveraging the position and Doppler velocity information. Finally, an extended Kalman filter (EKF) is employed to fuse the physical quantities obtained by each sensor, resulting in more robust pose estimation results. To validate the performance of the proposed method, experiments were conducted in foggy environments, including straight and curved driving scenarios. The experimental results indicate that the performance of the camera-based method is reduced due to frame loss in visually challenging scenarios such as foggy environments, whereas the proposed method exhibits superior performance and enhanced robustness.Keywords
This publication has 29 references indexed in Scilit:
- The Mechanistic Determination of Doping Contrast from Fermi Level Pinned Surfaces in the Scanning Electron Microscope Using Energy-Filtered Imaging and Calculated Potential DistributionsMicroscopy and Microanalysis, 2022
- LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping2020
- nuScenes: A Multimodal Dataset for Autonomous Driving2020
- Unravelling new principles of site-selective doping contrast in the dual-beam focused ion beam/scanning electron microscopeUltramicroscopy, 2020
- Camera and Radar Sensor Fusion for Robust Vehicle Localization via Vehicle Part LocalizationIEEE Access, 2020
- Radar Localization and Mapping for Indoor Disaster Environments via Multi-modal Registration to Prior LiDAR Map2019
- You Only Look Once: Unified, Real-Time Object Detection2016
- Low-drift and real-time lidar odometry and mappingAutonomous Robots, 2016
- Instantaneous ego-motion estimation using Doppler radar2013
- Vision-based lateral position improvement of RADAR detections2012