Where To Look: Focus Regions for Visual Question Answering
Preprint
Abstract
We present a method that learns to answer visual questions by selecting image regions relevant to the text-based query. Our method exhibits significant improvements in answering questions such as "what color," where it is necessary to evaluate a specific location, and "what room," where it selectively identifies informative image regions. Our model is tested on the VQA dataset which is the largest human-annotated visual question answering dataset to our knowledge.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Long-Term Recurrent Convolutional Networks for Visual Recognition and DescriptionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Visual-Semantic Alignments for Generating Image DescriptionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Ask Your Neurons: A Neural-Based Approach to Answering Questions about Images2015
- Visual Madlibs: Fill in the Blank Description Generation and Question Answering2015
- From captions to visual concepts and back2015
- ImageNet Large Scale Visual Recognition Challenge