Ground–Satellite Coupling for Cross-View Geolocation Combined With Multiscale Fusion of Spatial Features
- 16 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
Abstract
Geolocating a street-view image by matching it with geotagged satellite images is crucial for location assessment. However, the perspective disparity between satellite and street-view images presents significant challenges. To address the issue, the mainstream approach is to convert satellite images to ground-level perspective. So, the reference satellite images not only required the center but also required the coverage to be consistent with the street-view images and sometimes even required consistency in the north direction, which is difficult to achieve in the practical applications. This letter introduces a ground-breaking method for converting ground-level images to satellite images. We effectively couple ground images and satellite images by establishing a hemispheric projection relationship to achieve conversion from ground images to satellite perspectives, thus solving the problem of huge perspective differences in cross-view geolocation (CVG). In addition, we propose the multiscale fusion of a spatial features mechanism to enhance deep feature representations and improve recall and geolocation accuracy. Our proposed methodology markedly enhances its practical utility and performance, attaining remarkable Top-1 accuracy rates of 75.08% on the CVACT_val dataset and 39.92% on the CVACT_test dataset, respectively, following a stringent quantitative appraisal. This advancement constitutes a substantial contribution to the progression of research in the field of CVG.Keywords
Funding Information
- National Natural Science Foundation of China (42001338)
This publication has 21 references indexed in Scilit:
- A cross-view geo-localization method guided by relation-aware global attentionMultimedia Systems, 2023
- Revisiting Near/Remote Sensing with Geospatial Attention2022
- Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image2022
- TransGeo: Transformer Is All You Need for Cross-view Image Geo-localization2022
- Multi‐scale attention encoder for street‐to‐aerial image geo‐localizationCAAI Transactions on Intelligence Technology, 2022
- Coming Down to Earth: Satellite-to-Street View Synthesis for Geo-Localization2021
- Lending Orientation to Neural Networks for Cross-View Geo-Localization2019
- CVM-Net: Cross-View Matching Network for Image-Based Ground-to-Aerial Geo-Localization2018
- Predicting Ground-Level Scene Layout from Aerial Imagery2017
- Localizing and Orienting Street Views Using Overhead Imagery2016