Single Shot Scene Text Retrieval
Preprint
Abstract
Textual information found in scene images provides high level semantic information about the image and its context and it can be leveraged for better scene understanding. In this paper we address the problem of scene text retrieval: given a text query, the system must return all images containing the queried text. The novelty of the proposed model consists in the usage of a single shot CNN architecture that predicts at the same time bounding boxes and a compact text representation of the words in them. In this way, the text based image retrieval task can be casted as a simple nearest neighbor search of the query text representation over the outputs of the CNN over the entire image database. Our experiments demonstrate that the proposed architecture outperforms previous state-of-the-art while it offers a significant increase in processing speed.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World GraphsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- An End-to-End TextSpotter with Explicit Alignment and Attention2018
- TextBoxes++: A Single-Shot Oriented Scene Text DetectorIEEE Transactions on Image Processing, 2018
- TextProposals: A text-specific selective search algorithm for word spotting in the wildPattern Recognition, 2017
- Towards End-to-End Text Spotting with Convolutional Recurrent Neural Networks2017
- YOLO9000: Better, Faster, Stronger2017
- Con-Text: Text Detection for Fine-Grained Object ClassificationIEEE Transactions on Image Processing, 2017
- An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Reading Text in the Wild with Convolutional Neural NetworksInternational Journal of Computer Vision, 2015
- Word Spotting and Recognition with Embedded AttributesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014