Multi-view Super Vector for Action Recognition
Authors:
- Zhuowei CaiZCZhuowei Cai
- Limin WangLWLimin Wang
- Xiaojiang PengXPXiaojiang Peng
- Yu QiaoYQYu Qiao
- 1 June 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 596-603
Abstract
Images and videos are often characterized by multiple types of local descriptors such as SIFT, HOG and HOF, each of which describes certain aspects of object feature. Recognition systems benefit from fusing multiple types of these descriptors. Two widely applied fusion pipelines are descriptor concatenation and kernel average. The first one is effective when different descriptors are strongly correlated, while the second one is probably better when descriptors are relatively independent. In practice, however, different descriptors are neither fully independent nor fully correlated, and previous fusion methods may not be satisfying. In this paper, we propose a new global representation, Multi-View Super Vector (MVSV), which is composed of relatively independent components derived from a pair of descriptors. Kernel average is then applied on these components to produce recognition result. To obtain MVSV, we develop a generative mixture model of probabilistic canonical correlation analyzers (M-PCCA), and utilize the hidden factors and gradient vectors of M-PCCA to construct MVSV for video representation. Experiments on video based action recognition tasks show that MVSV achieves promising results, and outperforms FV and VLAD with descriptor concatenation or kernel average fusion strategy.Keywords
This publication has 29 references indexed in Scilit:
- All About VLAD2013
- Better Exploiting Motion for Better Action Recognition2013
- Human activity analysisACM Computing Surveys, 2011
- Fisher Kernels on Visual Vocabularies for Image Categorization2007
- Behavior Recognition via Sparse Spatio-Temporal Features2006
- On Space-Time Interest PointsInternational Journal of Computer Vision, 2005
- Canonical Correlation Analysis: An Overview with Application to Learning MethodsNeural Computation, 2004
- Video Google: a text retrieval approach to object matching in videos2003
- KERNEL AND NONLINEAR CANONICAL CORRELATION ANALYSISInternational Journal of Neural Systems, 2000
- Hierarchical Mixtures of Experts and the EM AlgorithmNeural Computation, 1994