Content-Based Movie Analysis and Indexing Based on AudioVisual Cues
Authors:
- 2 August 2004
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 14 (8) , 1073-1085
Abstract
A content-based movie parsing and indexing approach is presented; it analyzes both audio and visual sources and accounts for their interrelations to extract high-level semantic cues. Specifically, the goal of this work is to extract meaningful movie events and assign them semantic labels for the purpose of content indexing. Three types of key events, namely, 2-speaker dialogs, multiple-speaker dialogs, and hybrid events, are considered. Moreover, speakers present in the detected movie dialogs are further identified based on the audio source parsing. The obtained audio and visual cues are then integrated to index the movie content. Our experiments have shown that an effective integration of the audio and visual sources can lead to a higher level of video content understanding, abstraction and indexing.Keywords
This publication has 32 references indexed in Scilit:
- Extracting story units from long programs for video browsing and navigation2002
- Support vector machines for speaker verification and identification2002
- Person identification in TV programsJournal of Electronic Imaging, 2001
- Audio content analysis for online audiovisual data segmentation and classificationIEEE Transactions on Speech and Audio Processing, 2001
- Constructing table-of-content for videosMultimedia Systems, 1999
- Comparison of automatic shot boundary detection algorithms1998
- Scene change detection in an MPEG-compressed video sequence1995
- Rapid scene analysis on compressed videoIEEE Transactions on Circuits and Systems for Video Technology, 1995
- Automatic parsing and indexing of news videoMultimedia Systems, 1995
- Robust text-independent speaker identification using Gaussian mixture speaker modelsIEEE Transactions on Speech and Audio Processing, 1995