Robust Semantic Mapping in Challenging Environments
- 21 May 2019
- journal article
- research article
- Published by Cambridge University Press (CUP) in Robotica
- Vol. 38 (2) , 256-270
Abstract
Summary: Visual simultaneous localization and mapping (visual SLAM) has been well developed in recent decades. To facilitate tasks such as path planning and exploration, traditional visual SLAM systems usually provide mobile robots with the geometric map, which overlooks the semantic information. To address this problem, inspired by the recent success of the deep neural network, we combine it with the visual SLAM system to conduct semantic mapping. Both the geometric and semantic information will be projected into the 3D space for generating a 3D semantic map. We also use an optical-flow-based method to deal with the moving objects such that our method is capable of working robustly in dynamic environments. We have performed our experiments in the public TUM dataset and our recorded office dataset. Experimental results demonstrate the feasibility and impressive performance of the proposed method.Keywords
This publication has 42 references indexed in Scilit:
- SUN RGB-D: A RGB-D scene understanding benchmark suite2015
- Visual Odometry Algorithm Using an RGB-D Sensor and IMU in a Highly Dynamic Environment2015
- Motion segmentation based robust RGB-D SLAM2014
- Dense 3D semantic mapping of indoor scenes from RGB-D images2014
- SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels2013
- Dense visual SLAM for RGB-D cameras2013
- Parallel Tracking and Mapping for Small AR Workspaces2007
- An efficient solution to the five-point relative pose problemIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004
- Bundle Adjustment — A Modern Synthesis2000