RATM: Recurrent Attentive Tracking Model
Authors:
- Samira Ebrahimi KahouSKSamira Ebrahimi Kahou
- Vincent MichalskiVMVincent Michalski
- Roland MemisevicRMRoland Memisevic
- Christopher PalCPChristopher Pal
- Pascal VincentPVPascal Vincent
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1613-1622
Abstract
We present an attention-based modular neural framework for computer vision. The framework uses a soft attention mechanism allowing models to be trained with gradient descent. It consists of three modules: a recurrent attention module controlling where to look in an image or video frame, a feature-extraction module providing a representation of what is seen, and an objective module formalizing why the model learns its attentive behavior. The attention module allows the model to focus computation on task-related information in the input. We apply the framework to several object tracking tasks and explore various design choices. We experiment with three data sets, bouncing ball, moving digits and the real-world KTH data set. The proposed RATM performs well on all three tasks and can generalize to related but previously unseen sequences from a challenging tracking data set.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Convolutional LSTM Networks for Subcellular Localization of Proteins2015
- A Neural Attention Model for Abstractive Sentence Summarization2015
- Object Tracking BenchmarkIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Visual Tracking: An Experimental SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Speech recognition with deep recurrent neural networks2013
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Histograms of Oriented Gradients for Human Detection2005
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Long Short-Term MemoryNeural Computation, 1997