SST: Single-Stream Temporal Action Proposals
Authors:
- Shyamal BuchSBShyamal Buch
- Victor EscorciaVEVictor Escorcia
- Chuanqi ShenCSChuanqi Shen
- Bernard GhanemBGBernard Ghanem
- Juan Carlos NieblesJNJuan Carlos Niebles
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 6373-6382
Abstract
Our paper presents a new approach for temporal detection of human actions in long, untrimmed video sequences. We introduce Single-Stream Temporal Action Proposals (SST), a new effective and efficient deep architecture for the generation of temporal action proposals. Our network can run continuously in a single stream over very long input video sequences, without the need to divide input into short overlapping clips or temporal windows for batch processing. We demonstrate empirically that our model outperforms the state-of-the-art on the task of temporal action proposal generation, while achieving some of the fastest processing speeds in the literature. Finally, we demonstrate that using SST proposals in conjunction with existing action classifiers results in improved state-of-the-art temporal action detection performance.Keywords
This publication has 23 references indexed in Scilit:
- Bag-of-Fragments2015
- A discriminative CNN video representation for event detection2015
- Actionness Ranking with Lattice Conditional Ordinal Random Fields2014
- Action Localization with Tubelets from Motion2014
- Parsing Videos of Actions with Segmental Grammars2014
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- On the Properties of Neural Machine Translation: Encoder–Decoder Approaches2014
- Activity representation with motion hierarchiesInternational Journal of Computer Vision, 2013
- Supervised Sequence Labelling2012