Clip based video summarization and ranking
Authors:
Open Access
- 7 July 2008
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 135-140
Abstract
In this paper, we present a new algorithm for video clip summarization and ranking, which is mainly based on a clip based video similarity measure and the affinity propagation clustering (AP) algorithm. We propose a proportional max-weighted bipartite matching algorithm for clip similarity measure. This method first generates a basic frame set and a corresponding proportion value set from each clip. Then it models two clips as a weighted bipartite graph, where the weight values are determined by both the direct frame similarities and the proportion values. Then the max-weighted bipartite matching is employed to measure the similarity between two clips. This method achieves good retrieval performance when the length of two clips varies greatly. With these clip similarities, clips are clustered using affinity propagation. The clips in one cluster generally describe the same video event. Video ranking is based on the cluster size and the average information entropy of each event. Experimental results are given to illustrate the proposed algorithm.Keywords
This publication has 16 references indexed in Scilit:
- Segmenting, Modeling, and Matching Video Clips Containing Multiple Moving ObjectsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Scenario based dynamic video abstractions using graph matching2005
- Rate-distortion optimal video summary generationIEEE Transactions on Image Processing, 2005
- Automatic music video summarization based on audio-visual-text analysis and alignment2005
- Retrieval of News Video Using Video Sequence Matching2005
- Identification of new commercials using repeated video sequence detection2005
- Hot Event Detection and Summarization by Graph Modeling and Matching2005
- Video matchingACM Transactions on Graphics, 2004
- An efficient algorithm for video sequence matching using the modified Hausdorff distance and the directed divergenceIEEE Transactions on Circuits and Systems for Video Technology, 2002
- Query by video clipMultimedia Systems, 1999