Monte Carlo Tree Search for Scheduling Activity Recognition
Authors:
- Mohamed R. AmerMAMohamed R. Amer
- Sinisa TodorovicSTSinisa Todorovic
- Alan FernAFAlan Fern
- Song-Chun ZhuSZSong-Chun Zhu
- 1 December 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15505499,p. 1353-1360
Abstract
This paper addresses recognition of human activities with stochastic structure, characterized by variable space-time arrangements of primitive actions, and conducted by a variable number of actors. Our approach classifies the activity of interest as well as identifies the relevant foreground in the video. Each activity representation is considered as a mixture distribution of BoWs captured by a Sum-Product Network (SPN). In our approach, SPN represents a linear mixture of many bags-of-words (BoWs) where each BoW represents an important foreground part of the activity. This mixture distribution is efficiently computed by organizing the BoWs in a hierarchy, where children BoWs are nested within parent BoWs. SPN allows us to model this mixture since it consists of terminal nodes representing BoWs, product nodes, and sum nodes organized in a number of layers. The products are aimed at encoding particular configurations of primitive actions, and the sums serve to capture their alternative configurations. SPN inference amounts to parsing the SPN graph, which yields the most probable explanation (MPE) of the video foreground. SPN inference has linear complexity in the number of nodes, under fairly general conditions, enabling fast and scalable recognition. The connectivity of SPN and the parameters of BoW distributions are learned under weak supervision using a variational EM algorithm. For our evaluation, we have compiled and annotated a new Volleyball dataset. Our classification accuracy and localization results are superior to those of the state of the art on current benchmarks as well as our Volleyball datasets.Keywords
This publication has 25 references indexed in Scilit:
- Sum-product networks for modeling activities with stochastic structure2012
- A Survey of Monte Carlo Tree Search MethodsIEEE Transactions on Computational Intelligence and AI in Games, 2012
- Discriminative Latent Models for Recognizing Contextual Group ActivitiesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Parsing video events with goal inference and intent prediction2011
- Unsupervised learning of event AND-OR grammar and semantics from video2011
- A chains model for localizing participants of group activities in videos2011
- Globally-optimal greedy algorithms for tracking a variable number of objects2011
- Human activity analysisACM Computing Surveys, 2011
- A Numerical Study of the Bottom-Up and Top-Down Inference Processes in And-Or GraphsInternational Journal of Computer Vision, 2010
- A Stochastic Grammar of ImagesFoundations and Trends in Computer Graphics and Vision, 2007