Multi-Vehicle Cooperative Simultaneous LiDAR SLAM and Object Tracking in Dynamic Environments
- 13 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (9) , 11411-11421
Abstract
Simultaneous localization and mapping (SLAM) and moving object detection and tracking (MODT) are two fundamental problems for autonomous driving systems. Multi-vehicle cooperative SLAM and cooperative object perception, which take advantage of multi-vehicle information sharing, can overcome inherent limitations of single vehicle perception, such as view occlusion. Solutions to SLAM and MODT usually rely on certain assumptions, such as the static environment assumption for SLAM and the accurate ego-vehicle pose assumption for MODT. However, it is difficult or even impossible to have these assumptions hold in complex dynamic environments. We propose a LiDAR-based coupled cooperative simultaneous SLAM and MODT (C-SLAMMODT) strategy, which not only handles the SLAM and tracking problems in dynamic environments but also overcomes limitations of single vehicle perception. The proposed C-SLAMMODT outperforms both cooperative SLAM and cooperative MODT. This method includes a cooperative SLAM module that can augment ego-vehicle pose estimation by shared information from neighbouring vehicles, a cooperative MODT module that applies a state-of-the-art adaptive feature-level fusion model to fuse multi-vehicle data, improving detection precision and overcoming the limitations of perception in occlusion situations. Furthermore, a unified factor graph optimization integrates the information obtained from ego-vehicle states, neighbor-vehicle shared data, and dynamic object states to augment pose estimation and realize object tracking. Various comparative experiments demonstrate the performance and advantages of the proposed C-SLAMMODT solution in terms of accuracy and robustness.Keywords
Funding Information
- Shanghai Jiao Tong University (SJTU) Young Talent Funding (WF220426002)
This publication has 54 references indexed in Scilit:
- V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction2020
- ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings2020
- LiDAR-Enhanced Connected Infrastructures Sensing and Broadcasting High-Resolution Traffic Information Serving Smart CitiesIEEE Access, 2019
- PointPillars: Fast Encoders for Object Detection From Point Clouds2019
- Networking and Communications in Autonomous Driving: A SurveyIEEE Communications Surveys & Tutorials, 2018
- Motion removal for reliable RGB-D SLAM in dynamic environmentsRobotics and Autonomous Systems, 2018
- Feature Pyramid Networks for Object Detection2017
- Low-drift and real-time lidar odometry and mappingAutonomous Robots, 2016
- Multiple-Robot Simultaneous Localization and Mapping: A ReviewJournal of Field Robotics, 2015
- Grid-based localization and local mapping with moving object detection and trackingInformation Fusion, 2011