MHCPP: A Motion-Based Historical Enhancement Collaborative Perception and Prediction Framework
- 3 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (11) , 19810-19820
Abstract
Multi-agent collaborative perception mitigates the issues of limited perception range and occlusion in single-vehicle perception through shared sensing information, resulting in improved perception performance. However, current collaborative strategies often fail to differentiate moving objects from the background in complex scenarios. This leads to critical object data being obscured by excessive background information during data fusion, complicating effective integration. Additionally, efficiently leveraging historical perception data remains a significant challenge. To address these issues, we propose a parameter-free motion attribute extraction module that captures motion features between consecutive frames, enabling more efficient utilization of historical information to enhance current perception. Specifically, we design two temporal modules to comprehensively explore both ego and collaborators’ historical information. Furthermore, we propose a method that simultaneously considers the relationships between global appearance features and local motion features of shared information, thereby enabling better integration of foreground object data during collaboration. We validate our algorithm through experiments conducted on both simulated and real-world collaborative benchmarks. Both qualitative and quantitative results demonstrate that our proposed MHCPP significantly outperforms state-of-the-art (SOTA) methods in terms of 3D object detection and prediction tasks.Keywords
Funding Information
- National Key Research and Development Program of China (2024YFE0211000)
- National Natural Science Foundation of China (62372329, 62506263, 62506264)
- Shanghai Scientific Innovation Foundation (23DZ1203400)
- China Postdoctoral Science Foundation (BX20250383, GZB20250385, 2025M771530, 2025M771539)
- Tongji-Qomolo Autonomous Driving Commercial Vehicle Joint Laboratory Project
- Xiaomi Young Talents Program
- Open Found of the Engineering Research Center of Intelligent Swarm Systems, Ministry of Education (ZZU-CISS-2024001)
This publication has 33 references indexed in Scilit:
- LISO: Lidar-Only Self-supervised 3D Object Detection2024
- V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecasting2023
- V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer2022
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detection2022
- Robust Instance Segmentation through Reasoning about Multi-Object Occlusion2021
- V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction2020
- When2com: Multi-Agent Perception via Communication Graph Grouping2020
- PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud2019
- PointPillars: Fast Encoders for Object Detection From Point Clouds2019
- Fully Motion-Aware Network for Video Object Detection2018