Sports Video Mining via Multichannel Segmental Hidden Markov Models
Authors:
- 21 August 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 11 (7) , 1301-1309
Abstract
We study sports video mining as a machine learning and statistical inference problem. We focus on mid-level semantic structures that can serve as building blocks for high-level semantic analysis. Particularly, we are interested in how to infer multiple coexistent structures jointly. We present a new multichannel segmental hidden Markov model (MCSHMM) that is a unique probabilistic graphical model with two advantages. One is the integration of both hierarchical and parallel dynamic structures that offers more flexibility and capacity of capturing the interaction between multiple Markov chains. The other is the incorporation of the segmental HMM (SHMM) to deal with variable-length observations. In addition, we develop a maximum a posteriori (MAP) estimator to optimize the model structure and parameters simultaneously. The proposed MCSHMM is used for American football video analysis. The experiment result shows that the MCSHMM outperforms existing HMMs and has potential to be extended for other video mining tasks.Keywords
This publication has 24 references indexed in Scilit:
- Recursive estimation of generative models of video2006
- Selection of generative models in classificationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Event detection in field sports video using audio-visual features and a support vector MachineIEEE Transactions on Circuits and Systems for Video Technology, 2005
- Semantic annotation of soccer videos: automatic highlights identificationComputer Vision and Image Understanding, 2003
- Automatic soccer video analysis and summarizationIEEE Transactions on Image Processing, 2003
- Soccer highlights detection and recognition using HMMs2003
- Baseball scene classification using multimedia features2003
- Automatic parsing of TV soccer programs2002
- Structure analysis of soccer video with hidden Markov models2002
- Qualitative estimation of camera motion parameters from video sequencesPattern Recognition, 1997