Semantic Loop Closure Detection for Intelligent Vehicles Using Panoramas
- 25 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 8 (10) , 4395-4405
Abstract
Loop Closure Detection is of great significance in the field of intelligent driving systems, as it reduces the cumulative error of the estimated position of the system and assists in generating a consistent global map. Existing methods differ in frame representation methods and the corresponding frame-matching strategy. Traditionally, local feature points and descriptors are studied extensively while recently global descriptors and semantic information extracted from deep learning methods are considered superior in terms of promoting a high-level understanding of the surrounding environments of robots. However, one of the most challenging problems of using semantic information for loop detection is how to deal with inconsistent visual contents from different viewpoints in the same place. In this paper, a semantic loop closure detection method using panoramas is proposed to address this issue. We design a pipeline for efficiently extracting and matching semantic information between frames to identify loops. Most importantly we propose a novel polar coordinate-based panorama representation to address the inconsistent visual appearance problem caused by viewpoint differences. Experiment results show that our proposed method can significantly increase the accuracy of loop closure detection tasks in challenging scenarios where traditional methods may fail.Keywords
Funding Information
- Guangdong Provincial Key Laboratory IRADS (2022B1212010006, R0400001-22)
- UIC research (R201902)
This publication has 53 references indexed in Scilit:
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Trajectories and Maneuvers of Surrounding Vehicles With Panoramic Camera ArraysIEEE Transactions on Intelligent Vehicles, 2016
- NetVLAD: CNN Architecture for Weakly Supervised Place Recognition2016
- The Role of Machine Vision for Intelligent VehiclesIEEE Transactions on Intelligent Vehicles, 2016
- Image Geo-Localization Based on MultipleNearest Neighbor Feature Matching UsingGeneralized GraphsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- BRIEF: Binary Robust Independent Elementary Features2010
- Fast Keypoint Recognition Using Random FernsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Object recognition from local scale-invariant features1999
- A Combined Corner and Edge Detector1988