V2I-Coop: Accurate Object Detection for Connected Automated Vehicles at Accident Black Spots With V2I Cross-Modality Cooperation
- 28 October 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (3) , 2043-2055
Abstract
Accurate object detection with on-board LiDAR sensors is crucial for ensuring driving safety of Connected Automated Vehicles (CAVs), especially at accident black spots with more occlusions. Fortunately, road-side infrastructure equipped with traffic cameras is usually available at these places, offers an extensive field of view and encounters fewer occlusions, and thus can provide sustained assistance to CAVs to improve their object detection performance. However, vehicle-to-infrastructure (V2I) cooperative object detection is quite challenging due to modality heterogeneity, agent heterogeneity, and bandwidth limitations. To address these challenges, in this paper, we propose V2I-Coop, an accurate object detection approach with V2I cross-modality cooperation for CAVs to improve perception performance at accident black spots. In V2I-Coop, first, we extract bird-eye-view (BEV) features from both multi-view 2D images and 3D point clouds, which facilitates the feature fusion of different modalities. Next, the most valuable features from the images are adaptively selected according to available bandwidth and then transmitted to CAVs. Then, a cross-modality feature fusion algorithm is adopted at CAVs to mitigate the modality difference and improve the feature fusion efficiency. Finally, extensive experiments demonstrate that V2I-Coop significantly improves the 3D object detection performance of CAVs at accident black spots.Keywords
Funding Information
- National Science Fund for Distinguished Young Scholars (62325208)
- National Natural Science Foundation of China (U2001204, 62072330, 62272339)
- Beijing-Tianjin-Hebei Basic Research Cooperation (F2024402027)
- Tianjin Science and Technology Plan (23ZYCGCG00710)
This publication has 36 references indexed in Scilit:
- BEVFormer: Learning Bird’s-Eye-View Representation from Multi-camera Images via Spatiotemporal Transformers2022
- PETR: Position Embedding Transformation for Multi-view 3D Object Detection2022
- V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer2022
- Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D2020
- Comparison of Accident Black Spot Identification Methods based on GPS Coordinates2020
- V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction2020
- PointPillars: Fast Encoders for Object Detection From Point Clouds2019
- Frustum PointNets for 3D Object Detection from RGB-D Data2018
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- Multi-view 3D Object Detection Network for Autonomous Driving2017