Modeling Actions through State Changes
Authors:
- Alireza FathiAFAlireza Fathi
- James M. RehgJRJames M. Rehg
- 1 June 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 2579-2586
Abstract
In this paper we present a model of action based on the change in the state of the environment. Many actions involve similar dynamics and hand-object relationships, but differ in their purpose and meaning. The key to differentiating these actions is the ability to identify how they change the state of objects and materials in the environment. We propose a weakly supervised method for learning the object and material states that are necessary for recognizing daily actions. Once these state detectors are learned, we can apply them to input videos and pool their outputs to detect actions. We further demonstrate that our method can be used to segment discrete actions from a continuous video of an activity. Our results outperform state-of-the-art action recognition and activity segmentation results.Keywords
This publication has 24 references indexed in Scilit:
- Detecting activities of daily living in first-person camera views2012
- Source constrained clustering2011
- Actions in context2009
- Machine Recognition of Human Activities: A SurveyIEEE Transactions on Circuits and Systems for Video Technology, 2008
- What, where and who? Classifying events by scene and object recognition2007
- A survey of advances in vision-based human motion capture and analysisComputer Vision and Image Understanding, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Video matching2004
- Recognizing human actions: a local SVM approach2004
- Computational perception of scene dynamics1996