An Intra-Class Ranking Metric for Remote Sensing Image Retrieval
Open Access
- 9 August 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (16) , 3943
Abstract
With the rapid development of internet technology in recent years, the available remote sensing image data have also been growing rapidly, which has led to an increased demand for remote sensing image retrieval. Remote sensing images contain rich visual and semantic features, and have high variability and complexity. Therefore, remote sensing image retrieval needs to fully utilize the information in the images to perform feature extraction and matching. Metric learning has been widely used in image retrieval as it can train embedding spaces with high discriminability. However, existing deep metric learning methods learn embedding spaces with high discriminability by maximizing the differences between classes, while ignoring inherent intra-class differences during the learning process. In this paper, we design a new sample generation mechanism to generate samples from positive samples that meet the boundary constraints, thus obtaining quantifiable intra-class differences from real positive samples. Based on the sample generation relationship, we use a self-supervised approach to design an intra-class ranking loss function, which improves the discriminability of the generated embedding space for samples of the same class and maintains their ranking relationship in the embedding space. Moreover, this loss function can be easily combined with existing deep metric learning methods. Our aim is to help the network to better extract features and further improve the performance of remote sensing image retrieval through the sample generation mechanism and intra-class ranking loss. Finally, we conduct extensive experiments on multiple remote-sensing image datasets using multiple evaluation metrics such as mAP@K, which demonstrate that using the sample-generated intra-class ranking loss function can effectively improve the performance of remote sensing image retrieval.Keywords
Funding Information
- the Nature Science Foundation of China (62071199, 20190302026GX, 20200201283JC, 20230201085GX)
- the Provincial Science and Technology Innovation Special Fund Project of Jilin Province (62071199, 20190302026GX, 20200201283JC, 20230201085GX)
- Natural Science Foundation of Jilin Province (62071199, 20190302026GX, 20200201283JC, 20230201085GX)
- Jilin Province Industry Key Core Technology Research Project (62071199, 20190302026GX, 20200201283JC, 20230201085GX)
This publication has 60 references indexed in Scilit:
- SIFT Meets CNN: A Decade Survey of Instance RetrievalIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2017
- Remote Sensing Image Scene Classification: Benchmark and State of the ArtProceedings of the IEEE, 2017
- Context Encoders: Feature Learning by Inpainting2016
- Learning Fine-Grained Image Similarity with Deep Ranking2014
- AN OPTIMAL ANTENNA PATTERN SYNTHESIS FOR ACTIVE PHASED ARRAY SAR BASED ON PARTICLE SWARM OPTIMIZATION AND ADAPTIVE WEIGHTING FACTORProgress in Electromagnetics Research C, 2009
- Content-based image retrieval at the end of the early yearsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Image Retrieval: Current Techniques, Promising Directions, and Open IssuesJournal of Visual Communication and Image Representation, 1999
- SIGNATURE VERIFICATION USING A “SIAMESE” TIME DELAY NEURAL NETWORKInternational Journal of Pattern Recognition and Artificial Intelligence, 1993