Collaborative Perception Datasets for Autonomous Driving: A Review
- 10 July 2025
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (16) , 30255-30274
Abstract
Collaborative perception has attracted growing interest from academia and industry due to its potential to enhance perception accuracy, safety, and robustness in autonomous driving through multi-agent information fusion. With the advancement of Vehicle-to-Everything (V2X) communication, numerous collaborative perception datasets have emerged, varying in cooperation paradigms, sensor configurations, data sources, and application scenarios. However, the absence of systematic summarization and comparative analysis hinders effective resource utilization and standardization of model evaluation. As the first comprehensive review focused on collaborative perception datasets, this work reviews and compares existing resources from a multi-dimensional perspective. We categorize datasets based on cooperation paradigms, examine their data sources and scenarios, and analyze sensor modalities and supported tasks. A detailed comparative analysis is conducted across multiple dimensions. We also outline key challenges and future directions, including dataset scalability, diversity, domain adaptation, standardization, privacy, and the integration of large language models. To support ongoing research, we provide a continuously updated online repository of collaborative perception datasets and related literature: https://github.com/frankwnb/Collaborative-Perception-Datasets-for-Autonomous-Driving.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (52174154)
This publication has 112 references indexed in Scilit:
- V2X-Real: A Largs-Scale Dataset for Vehicle-to-Everything Cooperative Perception2024
- RoScenes: A Large-Scale Multi-view 3D Dataset for Roadside Perception2024
- GraphBEV: Towards Robust BEV Feature Alignment for Multi-modal 3D Object Detection2024
- H-V2X: A Large Scale Highway Dataset for BEV Perception2024
- DOLPHINS: Dataset for Collaborative Perception Enabled Harmonious and Interconnected Self-driving2023
- V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer2022
- Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D2020
- V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction2020
- A survey of deep learning techniques for autonomous drivingJournal of Field Robotics, 2019
- AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles2017