Video Summarization Based on Mutual Information and Entropy Sliding Window Method
Open Access
Abstract
This paper proposes a video summarization algorithm called the Mutual Information and Entropy based adaptive Sliding Window (MIESW) method, which is specifically for the static summary of gesture videos. Considering that gesture videos usually have uncertain transition postures and unclear movement boundaries or inexplicable frames, we propose a three-step method where the first step involves browsing a video, the second step applies the MIESW method to select candidate key frames, and the third step removes most redundant key frames. In detail, the first step is to convert the video into a sequence of frames and adjust the size of the frames. In the second step, a key frame extraction algorithm named MIESW is executed. The inter-frame mutual information value is used as a metric to adaptively adjust the size of the sliding window to group similar content of the video. Then, based on the entropy value of the frame and the average mutual information value of the frame group, the threshold method is applied to optimize the grouping, and the key frames are extracted. In the third step, speeded up robust features (SURF) analysis is performed to eliminate redundant frames in these candidate key frames. The calculation of Precision, Recall, and F are optimized from the perspective of practicality and feasibility. Experiments demonstrate that key frames extracted using our method provide high-quality video summaries and basically cover the main content of the gesture video.
Keywords
Funding Information
- National Natural Science Foundation of China (61070015)
- Natural Science Fund Team Project of Guangdong Province (10351806001000000)
- Collaborative Innovation Project of Guangzhou City (201604016074)
This publication has 28 references indexed in Scilit:
- Video super-resolution based on automatic key-frame selection and feature-guided variational optical flowSignal Processing: Image Communication, 2014
- Interactive Exploration of Surveillance Video through Action Shot Summarization and Trajectory VisualizationIEEE Transactions on Visualization and Computer Graphics, 2013
- Adaptive key frame extraction for video summarization using an aggregation mechanismJournal of Visual Communication and Image Representation, 2012
- VSUMM: A mechanism designed to produce static video summaries and a novel evaluation methodPattern Recognition Letters, 2011
- Hierarchical Keyframe-based Video Summarization Using QR-Decomposition and Modified -Means ClusteringEURASIP Journal on Advances in Signal Processing, 2010
- Video shot boundary detection: Seven years of TRECVid activityComputer Vision and Image Understanding, 2010
- Shot-based video retrieval with optical flow tensor and HMMsPattern Recognition Letters, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Key frame selection by motion analysis2002
- Multimodality image registration by maximization of mutual informationIEEE Transactions on Medical Imaging, 1997