Key-Frame Extraction Using Weighted Multi-view Convex Mixture Models and Spectral Clustering
Authors:
- Antonis I. IoannidisAIAntonis I. Ioannidis
- Vasileios T. ChasanisVCVasileios T. Chasanis
- Aristidis C. LikasALAristidis C. Likas
- 1 August 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3463-3468
Abstract
Reliable video summarization is one of the most important problems in digital video processing and analysis. The most common approach used for shot representation is the extraction of a set of key-frames sufficiently representing the total content of the shot. In such way, the whole video content can be represented using only a few, cautiously picked, non redundant key-frames maintaining at the same time a great percentage of information. A typical approach is to extract key frames using clustering. However, using a single image descriptor to extract key-frames is not sufficient due to large variations in the visual content of videos. In our approach, a weighted multi-view clustering algorithm is employed to combine two different image descriptors into a single similarity matrix, that serves as an input to a spectral clustering algorithm. Each image descriptor (view) does not contribute equally to the similarity matrix, but the weighted multi-view clustering algorithm associates a weight with each view and learns these weights automatically. Numerical experiments using a variety of videos demonstrate that our method is capable of efficiently summarizing video shots regardless of the characteristics of the visual content of the video.Keywords
This publication has 12 references indexed in Scilit:
- Multiple View Clustering Using a Weighted Combination of Exemplar-Based Mixture ModelsIEEE Transactions on Neural Networks, 2010
- Scene Detection in Videos Using Shot Clustering and Sequence AlignmentIEEE Transactions on Multimedia, 2008
- Evaluating bag-of-visual-words representations in scene classification2007
- An innovative algorithm for key frame extraction in video summarizationJournal of Real-Time Image Processing, 2006
- Information theory-based shot cut/fade detection and video summarizationIEEE Transactions on Circuits and Systems for Video Technology, 2005
- Detection and representation of scenes in videosIEEE Transactions on Multimedia, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- The global k-means clustering algorithmPattern Recognition, 2003
- Key frame selection by motion analysis2002
- Time-Constrained Keyframe Selection TechniqueMultimedia Tools and Applications, 2000