Retrieving Images with Generated Textual Descriptions
Authors:
- 1 July 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5812-5815
Abstract
This paper presents a novel remote sensing (RS) image retrieval system that is defined based on generation and exploitation of textual descriptions that model the content of RS images. The proposed RS image retrieval system is composed of three main steps. The first one generates textual descriptions of the content of the RS images combining a convolutional neural network (CNN) and a recurrent neural network (RNN) to extract the features of the images and to generate the descriptions of their content, respectively. The second step encodes the semantic content of the generated descriptions using word embedding techniques able to produce semantically rich word vectors. The third step retrieves the most similar images with respect to the query image by measuring the similarity between the encoded generated textual descriptions of the query image and those of the archive. Experimental results on RS image archive composed of RS images acquired by unmanned aerial vehicles (UAVs) are reported and discussed.Keywords
This publication has 10 references indexed in Scilit:
- Enriching Word Vectors with Subword InformationTransactions of the Association for Computational Linguistics, 2017
- Multilabel Remote Sensing Image Retrieval Using a Semisupervised Graph-Theoretic MethodIEEE Transactions on Geoscience and Remote Sensing, 2017
- Glove: Global Vectors for Word Representation2014
- A Systematic Comparison of Smoothing Techniques for Sentence-Level BLEU2014
- Remote Sensing Image Retrieval by Scene Semantic MatchingIEEE Transactions on Geoscience and Remote Sensing, 2012
- Semantic-Sensitive Satellite Image RetrievalIEEE Transactions on Geoscience and Remote Sensing, 2007
- Image Retrieval from the World Wide WebACM Computing Surveys, 2004
- Automatic linguistic indexing of pictures by a statistical modeling approachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- The Earth Mover's Distance as a Metric for Image RetrievalInternational Journal of Computer Vision, 2000
- Long Short-Term MemoryNeural Computation, 1997