SPS: Accurate and Real-Time Semantic Positioning System Based on Low-Cost DEM Maps
- 17 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 32 (10577149) , 6401-6412
Abstract
This paper presents a Semantic Positioning System (SPS) to enhance the accuracy of mobile device geo-localization in outdoor urban environments. Although the traditional Global Positioning System (GPS) can offer a rough localization, it lacks the necessary accuracy for applications such as Augmented Reality (AR). Our SPS integrates Geographic Information System (GIS) data, GPS signals, and visual image information to estimate the 6 Degree-of-Freedom (DoF) pose through cross-view semantic matching. This approach has excellent scalability to support GIS context with Levels of Detail (LOD). The map data representation is Digital Elevation Model (DEM), a cost-effective aerial map that allows for fast deployment for large-scale areas. However, the DEM lacks geometric and texture details, making it challenging for traditional visual feature extraction to establish pixel/voxel level cross-view correspondences. To address this, we sample observation pixels from the query ground-view image using predicted semantic labels. We then propose an iterative homography estimation method with semantic correspondences. To improve the efficiency of the overall system, we further employ a heuristic search to speedup the matching process. The proposed method is robust, real-time, and automatic. Quantitative experiments on the challenging Bund dataset show that we achieve a positioning accuracy of 73.24%, surpassing the baseline skyline-based method by 20%. Compared with the state-of-the-art semantic-based approach on the Kitti dataset, we improve the positioning accuracy by an average 5%.Keywords
Funding Information
- National Natural Science Foundation of China (62220106003)
- Research Grant of the Beijing Higher Institution Engineering Research Center
This publication has 39 references indexed in Scilit:
- Instant Outdoor Localization and SLAM Initialization from 2.5D MapsIEEE Transactions on Visualization and Computer Graphics, 2015
- Image Based Geo-localization in the AlpsInternational Journal of Computer Vision, 2015
- Geometric Urban Geo-localization2014
- Video/GIS registration system based on skyline matching method2013
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- Image to LIDAR matching for geotagging in urban environments2013
- Skyline matching: A robust registration method between Video and GIS2012
- Large Scale Visual Geo-Localization of Images in Mountainous Terrain2012
- Sketching up the world: in situ authoring for mobile Augmented RealityPersonal and Ubiquitous Computing, 2011
- Pose estimation using both points and lines for geo-localization2011