Multiple Features But Few Labels?
Open Access
- 3 November 2014
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 77-86
Abstract
Video analysis has been attracting increasing research due to the proliferation of internet videos. In this paper, we investigate how to improve the performance on internet quality video analysis. Particularly, we work on the scenario of few labeled training videos being provided, which is less focused in multimedia. To being with, we consider how to more effectively harness the evidences from the low-level features. Researchers have developed several promising features to represent videos to capture the semantic information. However, as videos usually characterize rich semantic contents, the analysis performance by using one single feature is potentially limited. Simply combining multiple features through early fusion or late fusion to incorporate more informative cues is doable but not optimal due to the heterogeneity and different predicting capability of these features. For better exploitation of multiple features, we propose to mine the importance of different features and cast it into the learning of the classification model. Our method is based on multiple graphs from different features and uses the Riemannian metric to evaluate the feature importance. On the other hand, to be able to use limited labeled training videos for a respectable accuracy we formulate our method in a semi-supervised way. The main contribution of this paper is a novel scheme of evaluating the feature importance that is further casted into a unified framework of harnessing multiple weighted features with limited labeled training videos. We perform extensive experiments on video action recognition and multimedia event recognition and the comparison to other state-of-the-art multi-feature learning algorithms has validated the efficacy of our framework.Keywords
Funding Information
- U.S. Department of War
- Zhejiang University (Open Project Program (Grant No. A1402))
- Seventh Framework Programme (project xLiMe)
- Army Research Office (W911NF-13-1-0277)
- Intelligence Advanced Research Projects Activity (IARPA) via Department of Interior National Business Center (D11PC20068)
This publication has 36 references indexed in Scilit:
- Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices2013
- Multimedia classification and event detection using double fusionMultimedia Tools and Applications, 2013
- Recognizing 50 human action categories of web videosMachine Vision and Applications, 2012
- Knowledge adaptation for ad hoc multimedia event detection with few exemplars2012
- Leveraging high-level and low-level features for multimedia event detection2012
- Multiple feature hashing for real-time large scale near-duplicate video retrieval2011
- Two-view Transductive Support Vector Machines2010
- The challenge problem for automated detection of 101 semantic concepts in multimedia2006
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Relations Between Two Sets of VariatesBiometrika, 1936