Joint Representation Learning Based on Feature Center Region Diffusion and Edge Radiation for Cross-View Geo-Localization
- 11 December 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-13
Abstract
The essence of the cross-view geo-localization task is to accurately identify the same object across images captured from different viewpoints. Due to variations in image acquisition methods and viewing angles, the content information of the images can differ significantly, which may result in localization failure. Therefore, cross-view geo-localization remains a challenging task. To solve this issue, a joint representation learning network based on feature center region diffusion and edge radiation is proposed in this article. First, to extract the crucial information from the global features, we design the central diffusion module that identifies important regions within the features and enhances feature robustness. Additionally, we design an edge radiation mechanism that expands the receptive field and further highlights crucial information in the image to support the central diffusion module in achieving more stable performance. On this basis, we propose an adaptive triple InfoNCE loss function to assist network training, improving the discriminability of the extracted features. Finally, the proposed network is tested on two mainstream datasets, and experimental results demonstrate that the proposed model outperforms the state-of-the-art methods, which can prove its effectiveness.Keywords
Funding Information
- National Natural Science Foundation of China (No. 61973066)
- Major Science and Technology Projects of Liaoning Province (No.2021JH1/10400049)
This publication has 45 references indexed in Scilit:
- Multi-mechanism swarm optimization for multi-UAV task assignment and path planning in transmission line inspection under multi-wind fieldApplied Soft Computing, 2023
- Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networksRemote Sensing of Environment, 2023
- Static hand gesture recognition in sign language based on convolutional neural network with feature extraction method using ORB descriptor and Gabor filterExpert Systems with Applications, 2022
- Comprehensive Multi-view Representation LearningInformation Fusion, 2022
- CVM-Net: Cross-View Matching Network for Image-Based Ground-to-Aerial Geo-Localization2018
- Predicting Ground-Level Scene Layout from Aerial Imagery2017
- Cross-View Image Matching for Geo-Localization in Urban Environments2017
- Deep Residual Learning for Image Recognition2016
- Learning deep representations for ground-to-aerial geolocalization2015
- Cross-View Image Geolocalization2013