RCQFusion: Radar and Camera Sensor Fusion with Joint Quantization for Robust Object Detection in Autonomous Driving
- 10 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. PP (00189456) , 1
Abstract
Object detection constitutes a crucial component for environment perception in autonomous driving systems, and the multi-modal fusion of millimeter-wave radar and camera is an effective solution to improve the accuracy and robustness of object detection. However, inherent sparsity and multi-noise of automotive radar data pose challenges to feature extraction, thereby resulting in low radar utilization. This limitation is further evidenced by existing fusion methods, where the decision weight assignment between the camera and the radar is unbalanced, and the decision contribution of radar often remains suboptimal in fusion processes. To address these issues, a novel radar-camera fusion framework with joint quantization for object detection is proposed. Specifically, considering the non-uniform density distribution and spatial sparsity of radar point clouds, an improved multi-dimensional density clustering algorithm is first developed to achieve effective noise filtering. Subsequently, a radar confidence factor is introduced based on the target point cloud's scalability to expand radar features. Furthermore, a dual-channel joint quantization matching mechanism is devised to enhance the decision contribution of radar during the fusion process. Comprehensive experiment and ablation studies conducted on the nuScenes dataset demonstrate that the proposed method exhibits superior inference speed, and the mAP outperforms comparison methods.Keywords
Funding Information
- National key research and development program (2022YFB3203600)
- National Natural Science Foundation of China (U1930206)
This publication has 41 references indexed in Scilit:
- Rotating Target Motion Parameter Measurement Using 77GHz Millimeter Wave Radar2024
- Object Detection Using Deep Learning, CNNs and Vision Transformers: A ReviewIEEE Access, 2023
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- Dynamic driving environment complexity quantification method and its verificationTransportation Research Part C: Emerging Technologies, 2021
- nuScenes: A Multimodal Dataset for Autonomous Driving2020
- PointPillars: Fast Encoders for Object Detection From Point Clouds2019
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- Feature Pyramid Networks for Object Detection2017
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Microsoft COCO: Common Objects in Context2014