Improving Dense Mapping for Mobile Robots in Dynamic Environments Based on Semantic Information
- 14 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (10) , 11740-11747
Abstract
In recent decades, semantic mapping has become a hot topic benefited from the maturity of visual simultaneous localization and mapping (visual SLAM) and the success of deep learning. Despite the impressive performance of the current state-of-the-art systems, semantic mapping in dynamic environments is still a challenging task. To address this problem, we propose a framework that fuses geometric information, semantic information, and human activity into a 3D dense map. The accuracy of the map is guaranteed by the reliable camera trajectory estimation and the static pixels used for 3D reconstruction. With the proposed framework, we achieve two objectives. On the one hand, we accurately reconstruct the environment from both geometric and semantic perspectives. On the other hand, we record human activity by tracking the human trajectory during the mapping period. We conduct both qualitative and quantitative experiments on the public TUM dataset. The experimental results demonstrate the feasibility and effectiveness of the proposed framework.Keywords
This publication has 26 references indexed in Scilit:
- Improving RGB-D SLAM in dynamic environments: A motion removal approachRobotics and Autonomous Systems, 2017
- Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception AgeIEEE Transactions on Robotics, 2016
- Effective Background Model-Based RGB-D Dense Visual Odometry in a Dynamic EnvironmentIEEE Transactions on Robotics, 2016
- Place categorization and semantic mapping on a mobile robot2016
- Direct visual-inertial odometry with stereo cameras2016
- Visual Odometry Algorithm Using an RGB-D Sensor and IMU in a Highly Dynamic Environment2015
- Keyframe-based visual–inertial odometry using nonlinear optimizationThe International Journal of Robotics Research, 2014
- A benchmark for the evaluation of RGB-D SLAM systems2012
- CoSLAM: Collaborative Visual SLAM in Dynamic EnvironmentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- DTAM: Dense tracking and mapping in real-time2011