STDC-SLAM: A Real-Time Semantic SLAM Detect Object by Short-Term Dense Concatenate Network
Authors:
Open Access
- 9 December 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 129419-129428
Abstract
Visual Simultaneous Localization and Mapping (SLAM) plays an important role in computer vision and robotic field. With the development of Convolutional Neural Network (CNN), most scholars currently fuse CNN with visual SLAM to reduce the impact of dynamic objects on visual SLAM. To address the impact of semantic segmentation networks with lower precision and quad-tree algorithm with over-uniform distribution of feature points on the location accuracy of SLAM, we proposed an STDC-SLAM: Short-Term Dense Concatenate Network SLAM, which was based on ORB-SLAM3. In the proposed system, a real-time STDC network was used for semantic thread to segment dynamic objects. On the one hand, we designed a segmentation refinement module to optimize the semantic segmentation maps using images depth information. On the other hand, we improved the Qtree-ORB algorithm by reducing the iterations of low-quality feature points in the rejection thread. We have evaluated our SLAM in public data sheets and compared it with ORB-SLAM3, DynaSLAM, PSPNet-SLAM. Experiments showed that our SLAM improved in localization accuracy compared to DynaSLAM and in processing speed compared to DynaSLAM and PSPNet-SLAM.Keywords
This publication has 30 references indexed in Scilit:
- Improving RGB-D SLAM in dynamic environments: A motion removal approachRobotics and Autonomous Systems, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Effective Background Model-Based RGB-D Dense Visual Odometry in a Dynamic EnvironmentIEEE Transactions on Robotics, 2016
- ORB-SLAM: A Versatile and Accurate Monocular SLAM SystemIEEE Transactions on Robotics, 2015
- Dense 3D SLAM in Dynamic Scenes Using Kinect2015
- Faster and Better: A Machine Learning Approach to Corner DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- BRIEF: Binary Robust Independent Elementary Features2010
- Parallel Tracking and Mapping for Small AR Workspaces2007
- MonoSLAM: Real-Time Single Camera SLAMIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004