MPOC-SLAM: An RGB-D SLAM System With Motion Probability and Object Category in High Dynamic Environments
- 25 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 30 (2) , 1061-1071
Abstract
The performance of simultaneous localization and mapping (SLAM) is significantly impacted by dynamic objects. Existing dynamic SLAM methods still suffer from some major issues, such as insufficient use of semantic information, losing track when dynamic objects occupy the field of view, and inability to achieve real-time processing. In this article, we present SLAM with motion probability and object category (MPOC-SLAM), an RGB-D SLAM system capable of high-performance, real-time work in high dynamic environments. Considering intensive semantic information, our method introduces the concepts of motion probability (MP) and object category (OC), and tightly integrates them within the whole SLAM system. First, a priority feature extraction strategy is proposed based on MP, and then a dual-constraint feature matching method is designed with the adaptive probability threshold and category consistency. Both methods reduce the influence of dynamic objects in the extraction and association process. Second, to speed up the process of calculating reprojection errors, a semantic-guided geometric method with the partitioning hypothetico-deductive method is presented. The semantic-guided geometric method and instance segmentation are then fused through the variance weighted fusion with their confidences. Finally, as a more important part of SLAM, dynamic-aware weights are added to the original pose optimization, which assigns larger weights to static feature points and map points to reduce their alteration during optimization. We perform evaluations on the TUM public dataset and real-world environments. Compared with ORB-SLAM2, the percentage reduction of root mean square error of absolute trajectory error is as high as 98.72%. Results show that MPOC-SLAM realizes a significant improvement in accuracy as well as a more robust and real-time performance compared with other state-of-the-art dynamic SLAM methods.Keywords
Funding Information
- National Natural Science Foundation of China (62293513, 62293510, 62303249)
- Natural Science Foundation of Tianjin Municipality (22JCZDJC00810)
- Fundamental Research Funds for the Central Universities
- K.C. Wong Education Foundation, Hong Kong
This publication has 34 references indexed in Scilit:
- YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors2023
- Self-support Few-Shot Semantic Segmentation2022
- SeqFormer: Sequential Transformer for Video Instance Segmentation2022
- YOLO-SLAM: A semantic SLAM system towards dynamic environment with geometric constraintNeural Computing and Applications, 2022
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- Geometry-based Graph Pruning for Lifelong SLAM2021
- An Adaptive Visual Dynamic-SLAM Method Based on Fusing the Semantic InformationIEEE Sensors Journal, 2021
- EM-Fusion: Dynamic Object-Level SLAM With Probabilistic Data Association2019
- VSO: Visual Semantic Odometry2018
- Robust RGB-D Odometry Using Point and Line Features2015