Towards Scalable Summarization of Consumer Videos Via Sparse Dictionary Selection
Authors:
Top Cited Papers
- 1 September 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 14 (1) , 66-75
Abstract
The rapid growth of consumer videos requires an effective and efficient content summarization method to provide a user-friendly way to manage and browse the huge amount of video data. Compared with most previous methods that focus on sports and news videos, the summarization of personal videos is more challenging because of its unconstrained content and the lack of any pre-imposed video structures. We formulate video summarization as a novel dictionary selection problem using sparsity consistency, where a dictionary of key frames is selected such that the original video can be best reconstructed from this representative dictionary. An efficient global optimization algorithm is introduced to solve the dictionary selection model with the convergence rates as O(1/K2) (where K is the iteration counter), in contrast to traditional sub-gradient descent methods of O(1/√K). Our method provides a scalable solution for both key frame extraction and video skim generation, because one can select an arbitrary number of key frames to represent the original videos. Experiments on a human labeled benchmark dataset and comparisons to the state-of-the-art methods demonstrate the advantages of our algorithm.Keywords
This publication has 25 references indexed in Scilit:
- Sparse reconstruction cost for abnormal event detection2011
- Tensor completion for estimating missing values in visual data2009
- An accelerated gradient method for trace norm minimization2009
- Kodak's consumer video benchmark data set2007
- Fusion of audio and motion information on HMM-based highlight extraction for baseball gamesIEEE Transactions on Multimedia, 2006
- Detection and representation of scenes in videosIEEE Transactions on Multimedia, 2005
- Intelligent keyframe extraction for video printing2004
- Video summaries and cross-referencing through mosaic-based representationComputer Vision and Image Understanding, 2004
- A user attention model for video summarization2002
- Similarity of color images1995