Improved Real-Time Monocular SLAM Using Semantic Segmentation on Selective Frames
Authors:
- Jinkyu LeeJLJinkyu Lee
- Muhyun BackMBMuhyun Back
- Sung Soo HwangSHSung Soo Hwang
- Il Yong ChunICIl Yong Chun
Preprint
Abstract
Monocular simultaneous localization and mapping (SLAM) is emerging in advanced driver assistance systems and autonomous driving, because a single camera is cheap and easy to install. Conventional monocular SLAM has two major challenges leading inaccurate localization and mapping. First, it is challenging to estimate scales in localization and mapping. Second, conventional monocular SLAM uses inappropriate mapping factors such as dynamic objects and low-parallax areas in mapping. This paper proposes an improved real-time monocular SLAM that resolves the aforementioned challenges by efficiently using deep learning-based semantic segmentation. To achieve the real-time execution of the proposed method, we apply semantic segmentation only to downsampled keyframes in parallel with mapping processes. In addition, the proposed method corrects scales of camera poses and three-dimensional (3D) points, using estimated ground plane from road-labeled 3D points and the real camera height. The proposed method also removes inappropriate corner features labeled as moving objects and low parallax areas. Experiments with eight video sequences demonstrate that the proposed monocular SLAM system achieves significantly improved and comparable trajectory tracking accuracy, compared to existing state-of-the-art monocular and stereo SLAM systems, respectively. The proposed system can achieve real-time tracking on a standard CPU potentially with a standard GPU support, whereas existing segmentation-aided monocular SLAM does not.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Ground-Plane-Based Absolute Scale Estimation for Monocular Visual OdometryIEEE Transactions on Intelligent Transportation Systems, 2019
- Augmented Reality Meets Computer Vision: Efficient Data Generation for Urban Driving ScenesInternational Journal of Computer Vision, 2018
- Keyframe-based monocular SLAM: design, survey, and future directionsRobotics and Autonomous Systems, 2017
- ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic SegmentationIEEE Transactions on Intelligent Transportation Systems, 2017
- High Accuracy Monocular SFM and Scale Correction for Autonomous DrivingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Visual SLAM: Why filter?Image and Vision Computing, 2012
- Automatic Relocalization and Loop Closing for Real-Time Monocular SLAMIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- MonoSLAM: Real-Time Single Camera SLAMIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004
- Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography1987