Long-Term Feature Banks for Detailed Video Understanding
Authors:
Top Cited Papers
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 284-293
Abstract
To understand the world, we humans constantly need to relate the present to the past, and put events in context. In this paper, we enable existing video models to do the same. We propose a long-term feature bank—supportive information extracted over the entire span of a video—to augment state-of-the-art video models that otherwise would only view short clips of 2-5 seconds. Our experiments demonstrate that augmenting 3D convolutional networks with a long-term feature bank yields state-of-the-art results on three challenging video datasets: AVA, EPIC-Kitchens, and Charades. Code is available online.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- Learning to Track for Spatio-Temporal Action Localization2015
- Fast R-CNN2015
- Learning Spatiotemporal Features with 3D Convolutional Networks2015
- Finding action tubes2015
- Long-term recurrent convolutional networks for visual recognition and description2015
- Beyond short snippets: Deep networks for video classification2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Large-Scale Video Classification with Convolutional Neural Networks2014
- Detection bank2012
- Learning Process in an Asymmetric Threshold Network1986