Soft Actor–Critic-Based Multilevel Cooperative Perception for Connected Autonomous Vehicles
- 2 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (21) , 21370-21381
Abstract
Cooperative perception is an effective way for connected autonomous vehicles to extend sensing range, improve detection precision, and thus enhance perception ability by combining their own sensing information with that of other vehicles. The existing cooperation perception schemes share only raw-, feature-, or object-level data, thus lacking the flexibility to adapt to highly dynamic vehicular network conditions, which leads to either bandwidth saturation or bandwidth underutilization, degrading the detection precision in the long run. In this article, we propose ML-Cooper, a multilevel cooperative perception framework, to fully utilize the bandwidth and hence improve detection precision. The key idea of ML-Cooper is to divide each frame of sensing data of the sender vehicle into three parts, and the corresponding raw data, feature data, and object data are transmitted to and fused at the receiver vehicle. We also develop a soft actor–critic (SAC) deep reinforcement learning algorithm to adaptively adjust the proportion of the three parts according to the channel state information of the Vehicle-to-Vehicle (V2V) link. The experimental results on KITTI and our collected data sets on two real vehicles show that ML-Cooper can achieve the highest average detection precision compared to existing single-level cooperative perception schemes.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFB2102400)
- NSFC Joint (U1836214, U2001204)
- National Natural Science Foundation of China (62072330)
- Natural Science Foundation of Tianjin (20211093)
This publication has 26 references indexed in Scilit:
- F-cooper2019
- Cooper: Cooperative Perception for Connected Autonomous Vehicles Based on 3D Point Clouds2019
- FusionEye: Perception Sharing for Connected Vehicles and its Bandwidth-Accuracy Trade-offs2019
- Federated Offloading Scheme to Minimize Latency in MEC-Enabled Vehicular Networks2018
- SECOND: Sparsely Embedded Convolutional DetectionSensors, 2018
- AVR2018
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Car2X-based perception in a high-level fusion architecture for cooperative perception systems2012
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009