ST-PixLoc: A Scene-Agnostic Network for Enhanced Camera Localization
Open Access
- 31 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 105294-105308
Abstract
Visual localization is a significant problem in computer vision and robotics, involving estimating the six degrees of freedom pose of a camera relative to a known environment based on captured images. Most DL-based visual localization methods exhibit poor generalization capabilities. While some scene-independent visual localization methods demonstrate satisfactory generalization, they often suffer from low localization accuracy. To address the issue of low accuracy in scene-independent methods and the indiscriminate fusion of channel and spatial information when using neural networks for feature extraction, we propose a visual localization method ST-PixLoc, which effectively leverages image edge gradient information using the PixLoc framework. Firstly, we optimize the gradients of input images to enhance the weighting of gradient values within the image. Secondly, we employ ResNet50 as the feature extraction network’s downsampling layers to enhance feature extraction capability, while introducing channel attention mechanisms in the upsampling layers of the feature extraction network. Notably, this mechanism focuses on relevant information and resolves the aforementioned indiscriminate fusion problem. Lastly, based on the feature maps of the considered images, we compute feature residuals and optimize the initial pose using optimization algorithms. Additionally, we optimize the loss function to improve the model’s accuracy in complex scenes. Experimental results demonstrate that the proposed method achieves high-precision localization. The average rotation and translation errors on the indoor 7-Scenes dataset increased by 6.9% and 9.7%, respectively, while those on the outdoor Cambridge Landmarks dataset increased by 16.7% and 28.2%, validating the effectiveness of the proposed approach.Keywords
Funding Information
- National Natural Science Foundation of China (62301414)
This publication has 36 references indexed in Scilit:
- A survey of state-of-the-art on visual SLAMExpert Systems with Applications, 2022
- RelocNet: Continuous Metric Learning Relocalisation Using Neural Nets2018
- MegaDepth: Learning Single-View Depth Prediction from Internet Photos2018
- Geometric Loss Functions for Camera Pose Regression with Deep Learning2017
- DSAC — Differentiable RANSAC for Camera Localization2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Discriminative Feature-to-Point Matching in Image-Based Localization2014
- Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images2013
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004
- A method for the solution of certain non-linear problems in least squaresQuarterly of Applied Mathematics, 1944