Convolutional neural network-based coarse initial position estimation of a monocular camera in large-scale 3D light detection and ranging maps
Authors:
Open Access
- 1 November 2019
- journal article
- research article
- Published by SAGE Publications in International Journal of Advanced Robotic Systems
- Vol. 16 (6)
Abstract
Initial position estimation in global maps, which is a prerequisite for accurate localization, plays a critical role in mobile robot navigation tasks. Global positioning system signals often become unreliable in disaster sites or indoor areas, which require other localization methods to help the robot in searching and rescuing. Many visual-based approaches focus on estimating a robot’s position within prior maps acquired with cameras. In contrast to conventional methods that need a coarse estimation of initial position to precisely localize a camera in a given map, we propose a novel approach that estimates the initial position of a monocular camera within a given 3D light detection and ranging map using a convolutional neural network with no retraining is required. It enables a mobile robot to estimate a coarse position of itself in 3D maps with only a monocular camera. The key idea of our work is to use depth information as intermediate data to retrieve a camera image in immense point clouds. We employ an unsupervised learning framework to predict the depth from a single image. Then we use a pretrained convolutional neural network model to generate depth image descriptors to construct representations of the places. We retrieve the position by computing similarity scores between the current depth image and the depth images projected from the 3D maps. Experiments on the publicly available KITTI data sets have demonstrated the efficiency and feasibility of the presented algorithm.Keywords
Funding Information
- National Natural Science Foundation of China (2017YFB1001900)
This publication has 10 references indexed in Scilit:
- Scale‐aware camera localization in 3D LiDAR maps with a monocular visual odometryComputer Animation and Virtual Worlds, 2019
- Intelligent Collaborative Localization Among Air-Ground Robots for Industrial Environment PerceptionIEEE Transactions on Industrial Electronics, 2018
- Distributed and collaborative monocular simultaneous localization and mapping for multi-robot systems in large-scale environmentsInternational Journal of Advanced Robotic Systems, 2018
- Multi-camera visual SLAM for autonomous navigation of micro aerial vehiclesRobotics and Autonomous Systems, 2017
- NetVLAD: CNN Architecture for Weakly Supervised Place RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep learningNature, 2015
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Bags of Binary Words for Fast Place Recognition in Image SequencesIEEE Transactions on Robotics, 2012
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Partial least-squares regression: a tutorialAnalytica Chimica Acta, 1986