An improved LIO-SAM algorithm by integrating image information for dynamic and unstructured environments
- 21 June 2024
- journal article
- research article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 35 (9) , 096313
Abstract
Simultaneous localization and mapping (SLAM) is the process of estimating the trajectory of a mobile sensor carrier and creating a representation of its surroundings. Traditional SLAM algorithms are based on ‘static world assumption’ and simplify the problem by filtering out moving objects or tracking them separately in complex dynamic environments. However, this strong assumption restricts the application of SLAM algorithms on highly dynamic and unstructured environments. In order to resolve above problem, this paper propose an improved object-aware dynamic SLAM system by integrating image information, i.e. semantic and velocity information. Firstly, we adopt deep learning method to detect both the 2D and 3D bounding boxes of objects in the environment. This information is then used to perform multi-view, multi-dimensional bundle optimization to jointly refine the poses of camera, object, and point. Secondly, 2D detection results from image and 3D detection results from lidar are integrated by the joint probabilistic data association data association algorithm to facilitate object-level data association. We also calculate 2D and 3D motion velocity and this information is used to constraint the motion of the object. Finally, we perform comprehensive experiments on different datasets, including NCLT, M2DGR, and KITTI to prove the performance of the proposed method.Keywords
Funding Information
- National Natural Science Foundation of China (61773360)
This publication has 62 references indexed in Scilit:
- DSP-SLAM: Object Oriented SLAM with Deep Shape Priors2021
- NodeSLAM: Neural Object Descriptors for Multi-View Shape Reconstruction2020
- ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings2020
- ClusterSLAM: A SLAM Backend for Simultaneous Rigid Body Clustering and Motion Estimation2019
- Multiple Object Tracking With Attention to Appearance, Structure, Motion and SizeIEEE Access, 2019
- PointPillars: Fast Encoders for Object Detection From Point Clouds2019
- Stereo Vision-Based Semantic 3D Object and Ego-Motion Tracking for Autonomous Driving2018
- ICE-BA: Incremental, Consistent and Efficient Bundle Adjustment for Visual-Inertial SLAM2018
- QuadricSLAM: Dual Quadrics as SLAM Landmarks2018
- SLAM++: Simultaneous Localisation and Mapping at the Level of Objects2013