A Survey on Monocular Re-Localization: From the Perspective of Scene Map Representation
- 19 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 10 (4) , 2519-2550
Abstract
Monocular Re-Localization (MRL) is an essential component in autonomous applications, estimating 6 degree-of-freedom ego poses w.r.t. the scene map using monocular images. Over the past few decades, there has been notable advancement in the field of MRL techniques. Several works have achieved remarkable success in terms of both the accuracy and reliability of localization. In MRL, scene maps are represented in diverse forms, and they dictate the functionality and efficacy of MRL methods. However, to the best of our knowledge, existing surveys do not provide systematic reviews about the correlation between MRL solutions and their used scene map representation. This survey fills the gap by comprehensively reviewing MRL methods from such a perspective, promoting further research. 1) We commence by delving into the problem definition of MRL, exploring current challenges, and comparing ours with existing surveys. 2) MRL methods are categorized and reviewed into five classes based on the representation forms of the utilized map, i.e., geo-tagged frames, visual landmarks, point clouds, vectorized semantic maps, and neural network-based maps. 3) To quantitatively and fairly compare MRL methods using different maps, we introduce some public datasets and evaluate the performances of several advanced MRL approaches. The strengths and shortcomings of MRL methods using various maps are analyzed. 4) Finally, we introduce some topics of interest in this field and provide our individual viewpoints. This survey can serve as a valuable resource for MRL, and a summary of this survey is accessible to the community at: github.com/jinyummiao/map-in-mono-relocKeywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (U22A20104, 52372414)
- Beijing Municipal Science and Technology Commission, Adminitrative Commission of Zhongguancun Science Park (Z221100008122011)
This publication has 258 references indexed in Scilit:
- Automatic vocabulary and graph verification for accurate loop closure detectionJournal of Field Robotics, 2022
- Fast and incremental loop closure detection with deep features and proximity graphsJournal of Field Robotics, 2022
- The MADMAX data set for visual‐inertial rover navigation on MarsJournal of Field Robotics, 2021
- Handcrafted Outlier Detection Revisited2020
- A Consistently Fast and Globally Optimal Solution to the Perspective-n-Point Problem2020
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020
- Learning Feature Descriptors Using Camera Pose Supervision2020
- Towards Resolving the Kidnapped Robot Problem: Topological Localization from Crowdsourcing and Georeferenced Images2019
- RPNet: An End-to-End Network for Relative Camera Pose Estimation2019
- RelocNet: Continuous Metric Learning Relocalisation Using Neural Nets2018