Human activity recognition using multidimensional indexing
Authors:
- 7 November 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 24 (8) , 1091-1104
Abstract
In this paper, we develop a novel method for view-based recognition of human action/activity from videos. By observing just a few frames, we can identify the activity that takes place in a video sequence. The basic idea of our method is that activities can be positively identified from a sparsely sampled sequence of a few body poses acquired from videos. In our approach, an activity is represented by a set of pose and velocity vectors for the major body parts (hands, legs, and torso) and stored in a set of multidimensional hash tables. We develop a theoretical foundation that shows that robust recognition of a sequence of body pose vectors can be achieved by a method of indexing and sequencing and it requires only a few pose vectors (i.e., sampled body poses in video frames). We find that the probability of false alarm drops exponentially with the increased number of sampled body poses. So, matching only a few body poses guarantees high probability for correct recognition. Our approach is parallel, i.e., all possible model activities are examined at one indexing operation. In addition, our method is robust to partial occlusion since each body part is indexed separately. We use a sequence-based voting approach to recognize the activity invariant to the activity speed.Keywords
This publication has 26 references indexed in Scilit:
- Cardboard people: a parameterized model of articulated image motion2002
- Head tracking via robust registration in texture map images2002
- The recognition of human movement using temporal templatesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Recognition of visual activities and interactions by stochastic parsingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- W/sup 4/: real-time surveillance of people and their activitiesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- The Visual Analysis of Human Movement: A SurveyComputer Vision and Image Understanding, 1999
- An appearance-based representation of action1996
- Monocular tracking of the human arm in 3D: real-time implementation and experiments1996
- Optimal template matching by nonorthogonal image expansion using restorationMachine Vision and Applications, 1994
- A novel approach for template matching by nonorthogonal image expansionIEEE Transactions on Circuits and Systems for Video Technology, 1993