Mental Retrieval of Remote Sensing Images via Adversarial Sketch-Image Feature Learning
- 17 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 58 (11) , 7801-7814
Abstract
Searching the targets of interest in large-scale remote sensing images is a fundamental problem, which becomes a very challenging issue when there is no relevant example at hand but a mental picture in mind. Hand-drawn sketch as a precise and convenient expression of the mental picture makes sketch-based remote sensing image retrieval (SBRSIR) an ideal choice to cope with this issue. However, the accuracy of SBRSIR algorithm, which is critical to effective retrieval, is still far behind classic query-by-example image retrieval. Two central limiting factors for this performance gap are: 1) the lack of effective cross-domain representations for bridging the domain gap between sketches and remote sensing images and 2) the absence of large sketch/remote sensing image data sets for developing, evaluating, and comparing the SBRSIR approaches. In this article, we first develop a novel SBRSIR model to learn a deep joint embedding space with discriminative losses, where adversarial training is used for the embedding space to learn domain-invariant representations. Then, we contribute a sketch/remote sensing image data set specifically for SBRSIR and provide a benchmark for subsequent researchers. Extensive experiments on the data set and large scene images demonstrate the effectiveness and superiority of the method for both the seen and unseen categories.Keywords
Funding Information
- National Natural Science Foundation of China (61771351, 61771350, 61922065)
- Project for Innovative Research Groups of the Natural Science Foundation of Hubei Province (2018CFA006)
This publication has 47 references indexed in Scilit:
- Sketch-based image retrieval using keyshapesMultimedia Tools and Applications, 2013
- A performance evaluation of gradient field HOG descriptor for sketch based image retrievalComputer Vision and Image Understanding, 2013
- A review of EO image information miningISPRS Journal of Photogrammetry and Remote Sensing, 2013
- How do humans sketch objects?ACM Transactions on Graphics, 2012
- Metric Learning for Large Scale Image Classification: Generalizing to New Classes at Near-Zero Cost2012
- High-resolution satellite scene classification using a sparse coding based multiple feature combinationInternational Journal of Remote Sensing, 2011
- A theory of learning from different domainsMachine Learning, 2009
- Shape matching and object recognition using shape contextsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Sketching interfaces: toward more human interface designComputer, 2001
- An environment for content-based image retrieval from large spatial databasesISPRS Journal of Photogrammetry and Remote Sensing, 1999