Scalable Video Event Retrieval by Visual State Binary Embedding
- 20 April 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 18 (8) , 1590-1603
Abstract
With the exponential increase of media data on the web, fast media retrieval is becoming a significant research topic in multimedia content analysis. Among the variety of techniques, learning binary embedding (hashing) functions is one of the most popular approaches that can achieve scalable information retrieval in large databases, and it is mainly used in the near-duplicate multimedia search. However, till now most hashing methods are specifically designed for near-duplicate retrieval at the visual level rather than the semantic level. In this paper, we propose a visual state binary embedding (VSBE) model to encode the video frames, which can preserve the essential semantic information in binary matrices, to facilitate fast video event retrieval in unconstrained cases. Compared with other video binary embedding models, one advantage of our proposed VSBE model is that it only needs a limited number of key frames from the training videos for hash function training, so the computational complexity is much lower in the training phase. At the same time, we apply the pairwise constraints generated from the visual states to sketch the local properties of the events at the semantic level, so accuracy is also ensured. We conducted extensive experiments on the challenging TRECVID MED dataset, and have proved the superiority of our proposed VSBE model.Keywords
This publication has 27 references indexed in Scilit:
- A discriminative CNN video representation for event detection2015
- Two dimensional hashing for visual trackingComputer Vision and Image Understanding, 2015
- Multiple Features But Few Labels?2014
- Video Event Detection by Inferring Temporal Instance Labels2014
- A Bag-of-Importance Model With Locality-Constrained Coding Based Feature Learning for Video SummarizationIEEE Transactions on Multimedia, 2014
- Category-Specific Video Summarization2014
- Large-Scale Video Hashing via Structure Learning2013
- Linear cross-modal hashing for efficient multimedia search2013
- Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognitionPattern Recognition, 2013
- Learning Compact Binary Codes for Visual Tracking2013