Recognizing Human Actions Using Silhouette-based HMM
Authors:
- Francisco Martinez-ContrerasFMFrancisco Martinez-Contreras
- Carlos Orrite-UrunuelaCOCarlos Orrite-Urunuela
- Elias Herrero-JarabaEHElias Herrero-Jaraba
- Hossein RaghebHRHossein Ragheb
- Sergio A. VelastinSergio A. Velastin
- 1 September 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 43-48
Abstract
This paper addresses the problem of silhouette-based human action modeling and recognition, specially when the number of action samples is scarce. The first step of the proposed system is the 2D modeling of human actions based on motion templates, by means of motion history images (MHI). These templates are projected into a new subspace using the Kohonen self organizing feature map (SOM), which groups viewpoint (spatial) and movement (temporal) in a principal manifold, and models the high dimensional space of static templates.The next step is based on the hidden Markov models (HMM) in order to track the map behavior on the temporal sequences of MHI. Every new MHI pattern is compared with the features map obtained during the training. The index of the winner neuron is considered as discrete observation for the HMM. If the number of samples is not enough, a sampling technique, the sampling importance resampling (SIR) algorithm, is applied in order to increase the number of observations for the HMM. Finally, temporal pattern recognition is accomplished by a maximum likelihood (ML) classifier. We demonstrate this approach on two publicly available dataset: one based on real actors and another one based on virtual actors.Keywords
This publication has 17 references indexed in Scilit:
- Machine Recognition of Human Activities: A SurveyIEEE Transactions on Circuits and Systems for Video Technology, 2008
- Visual learning and recognition of sequential data manifolds with applications to human movement analysisComputer Vision and Image Understanding, 2008
- Human action recognition using robust power spectrum features2008
- Actions as Space-Time ShapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Systematic testing of generalization level during training in regression-type learning scenarios2005
- A Survey on Visual Surveillance of Object Motion and BehaviorsIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2004
- Gait-based recognition of humans using continuous HMMs2003
- Sequential Monte Carlo Methods in Practice2001
- Self-Organization and Associative Memory1989
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989