Modality Mixture Projections for Semantic Video Event Detection
Authors:
- Dacheng TaoDTDacheng Tao
- Xuelong LiXLXuelong Li
- 26 September 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 18 (11) , 1587-1596
Abstract
Event detection is one of the most fundamental components for various kinds of domain applications of video information system. In recent years, it has gained a considerable interest of practitioners and academics from different areas. While detecting video event has been the subject of extensive research efforts recently, much less existing approach has considered multimodal information and related efficiency issues. In this paper, we use a subspace selection technique to achieve fast and accurate video event detection using a subspace selection technique. The approach is capable of discriminating different classes and preserving the intramodal geometry of samples within an identical class. With the method, feature vectors presenting different kind of multi data can be easily projected from different identities and modalities onto a unified subspace, on which recognition process can be performed. Furthermore, the training stage is carried out once and we have a unified transformation matrix to project different modalities. Unlike existing multimodal detection systems, the new system works well when some modalities are not available. Experimental results based on soccer video and TRECVID news video collections demonstrate the effectiveness, efficiency and robustness of the proposed MMP for individual recognition tasks in comparison to the existing approaches.Keywords
This publication has 13 references indexed in Scilit:
- Multimodal biometrics using geometry preserving projectionsPattern Recognition, 2008
- Video Semantic Event/Concept Detection Using a Subspace-Based Multimedia Data Mining FrameworkIEEE Transactions on Multimedia, 2008
- Rank-One Projections With Adaptive Margins for Face RecognitionIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2007
- Visual Event Recognition in News Video using Kernel Methods with Multi-Level Temporal Alignment2007
- Element Rearrangement for Tensor-Based Subspace Learning2007
- Event detection in field sports video using audio-visual features and a support vector MachineIEEE Transactions on Circuits and Systems for Video Technology, 2005
- Semantic Indexing of Soccer Audio-Visual Sequences: A Multimodal Approach Based on Controlled Markov ChainsIEEE Transactions on Circuits and Systems for Video Technology, 2004
- The segmentation of news video into story units2003
- Multi-modal extraction of highlights from TV Formula 1 programs2002
- On the automatic indexing of cricket using camera motion parameters2002