Semantic SLAM for mobile robots in dynamic environments based on visual camera sensors
Authors:
Open Access
- 11 May 2023
- journal article
- research article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 34 (8) , 085202
Abstract
Visual simultaneous localization and mapping (vSLAM) is inherently constrained by the static world assumption, which renders success in the presence of dynamic objects rather challenging. In this paper, we propose a real-time semantic vSLAM system designed for both indoor and outdoor dynamic environments. By employing object detection, we identify 80 categories and utilize motion consistency checks to pinpoint outliers in each image. Distinct methods are presented for examining the motion states of humans and other objects. For detected humans, an algorithm is introduced to assess whether an individual is seated, subsequently dividing the bounding boxes of seated individuals into two parts based on human body proportions. We then use the same threshold values for standing individuals to determine the states of the two boxes belonging to seated individuals. For non-human objects, we propose an algorithm capable of automatically adjusting the threshold values for different bounding boxes, thereby ensuring consistent detection performance across various objects. Ultimately, we retain points within static boxes contained in dynamic boxes while eliminating other points in dynamic boxes to benefit from a larger number of detected categories. Our SLAM is evaluated on indoor TUM and Bonn RGB-D datasets, with further testing conducted on the outdoor stereo KITTI dataset. The results reveal that our SLAM outperforms most SLAM systems in dynamic environments. Moreover, we test our system in real-world environments with a monocular camera, demonstrating its robustness and universality across diverse settings.Keywords
This publication has 25 references indexed in Scilit:
- Handheld 3D reconstruction based on closed-loop detection and nonlinear optimizationMeasurement Science and Technology, 2019
- Indirect Visual Simultaneous Localization and Mapping Based on Linear ModelsIEEE Sensors Journal, 2019
- ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residuals2019
- Real-Time 3D Motion Tracking and Reconstruction System Using Camera and IMU SensorsIEEE Sensors Journal, 2019
- DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic ScenesIEEE Robotics and Automation Letters, 2018
- Improving RGB-D SLAM in dynamic environments: A motion removal approachRobotics and Autonomous Systems, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- Random sample consensusCommunications of the ACM, 1981
- Recognition memory for a rapid sequence of pictures.Journal of Experimental Psychology, 1969