Audio keywords generation for sports video analysis
Authors:
Open Access
- 16 May 2008
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 4 (2) , 1-23
Abstract
Sports video has attracted a global viewership. Research effort in this area has been focused on semantic event detection in sports video to facilitate accessing and browsing. Most of the event detection methods in sports video are based on visual features. However, being a significant component of sports video, audio may also play an important role in semantic event detection. In this paper, we have borrowed the concept of the “keyword” from the text mining domain to define a set of specific audio sounds. These specific audio sounds refer to a set of game-specific sounds with strong relationships to the actions of players, referees, commentators, and audience, which are the reference points for interesting sports events. Unlike low-level features, audio keywords can be considered as a mid-level representation, able to facilitate high-level analysis from the semantic concept point of view. Audio keywords are created from low-level audio features with learning by support vector machines. With the help of video shots, the created audio keywords can be used to detect semantic events in sports video by Hidden Markov Model (HMM) learning. Experiments on creating audio keywords and, subsequently, event detection based on audio keywords have been very encouraging. Based on the experimental results, we believe that the audio keyword is an effective representation that is able to achieve satisfying results for event detection in sports video. Application in three sports types demonstrates the practicality of the proposed method.Keywords
This publication has 25 references indexed in Scilit:
- A unified framework for semantic shot classification in sports videoIEEE Transactions on Multimedia, 2005
- Event detection in field sports video using audio-visual features and a support vector MachineIEEE Transactions on Circuits and Systems for Video Technology, 2005
- Semantic Indexing of Soccer Audio-Visual Sequences: A Multimodal Approach Based on Controlled Markov ChainsIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Structure analysis of soccer video with domain knowledge and hidden Markov modelsPattern Recognition Letters, 2004
- Detection of slow-motion replay segments in sports video for highlights generation2002
- Shot-boundary detection: unraveled and resolved?IEEE Transactions on Circuits and Systems for Video Technology, 2002
- Automatic detection of 'Goal' segments in basketball videos2001
- Content-Based Audio Classification and Retrieval for Audiovisual Data Parsing2001
- Automatically extracting highlights for TV Baseball programs2000
- Discrete-Time Processing of Speech Signals1999