SemLoc: Accurate and Robust Visual Localization with Semantic and Structural Constraints from Prior Maps
Authors:
- 23 May 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4135-4141
Abstract
Semantic information and geometrical structures of a prior map can be leveraged in visual localization to bound drift errors and improve accuracy. In this paper, we propose SemLoc, a pure visual localization system, for accurate localization in a prior semantic map. To tightly couple semantic and structure information from prior maps, a hybrid constraint is presented by using the Dirichlet distribution. Then, with the local landmarks and their semantic states tracked in the frontend, the camera poses and data associations are jointly optimized through Expectation-Maximization (EM) algorithm. We validate the effectiveness of our approach in both monocular and stereo modes on the public KITTI dataset. Experimental results demonstrate that our system can greatly reduce drift errors with an satisfying real-time performance. Compared with several state-of-the-art visual localization systems, the proposed framework achieves a competitive localization performance.Keywords
Funding Information
- National Natural Science Foundation of China (61973066,61471110)
This publication has 27 references indexed in Scilit:
- Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras2017
- ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D CamerasIEEE Transactions on Robotics, 2017
- Probabilistic data association for semantic SLAM2017
- Direct Sparse OdometryIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Monocular camera localization in 3D LiDAR maps2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- Aggregating local descriptors into a compact image representation2010
- Generalized-ICP2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004