ICDAR 2019 Competition on Scene Text Visual Question Answering
Authors:
- 1 September 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1563-1570
Abstract
This paper presents final results of ICDAR 2019 Scene Text Visual Question Answering competition (ST-VQA). ST-VQA introduces an important aspect that is not addressed by any Visual Question Answering system up to date, namely the incorporation of scene text to answer questions asked about an image. The competition introduces a new dataset comprising 23,038 images annotated with 31,791 question / answer pairs where the answer is always grounded on text instances present in the image. The images are taken from 7 different public computer vision datasets, covering a wide range of scenarios. The competition was structured in three tasks of increasing difficulty, that require reading the text in a scene and understanding it in the context of the scene, to correctly answer a given question. A novel evaluation metric is presented, which elegantly assesses both key capabilities expected from an optimal model: text recognition and image understanding. A detailed analysis of results from different participants is showcased, which provides insight into the current capabilities of VQA systems that can read. We firmly believe the dataset proposed in this challenge will be an important milestone to consider towards a path of more robust and general models that can exploit scene text to achieve holistic image understanding.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning2017
- Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering2017
- Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image AnnotationsInternational Journal of Computer Vision, 2017
- Dynamic Lexicon Generation for Natural Scene Images2016
- VQA: Visual Question Answering2015
- ICDAR 2015 competition on Robust Reading2015
- Word Spotting and Recognition with Embedded AttributesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Image Retrieval Using Textual Cues2013
- ICDAR 2013 Robust Reading Competition2013
- Undoing the Damage of Dataset Bias2012