Multiple camera tracking of interacting and occluded human motion
Authors:
- 1 October 2001
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 89 (10) , 1441-1455
Abstract
We propose a distributed, real-time computing platform for tracking multiple interacting persons in motion. To combat the negative effects of occlusion and articulated motion we use a multiview implementation, where each view is first independently processed on a dedicated processor. This monocular processing uses a predictor-corrector filter to weigh reprojections of three-dimensional (3-D) position estimates, obtained by the central processor, against observations of measurable image motion. The corrected state vectors from each view provide input observations to a Bayesian belief network, in the central processor, with a dynamic, multidimensional topology that varies as a function of scene content and feature confidence. The Bayesian net fuses independent observations from multiple cameras by iteratively resolving independency relationships and confidence levels within the graph, thereby producing the most likely vector of 3-D state estimates given the available data. To maintain temporal continuity, we follow the network with a layer of Kalman filtering that updates the 3-D state estimates. We demonstrate the efficacy of the proposed system using a multiview sequence of several people in motion. Our experiments suggest that, when compared with data fusion based on averaging, the proposed technique yields a noticeable improvement in tracking accuracy.Keywords
This publication has 47 references indexed in Scilit:
- An optimal image selection from multiple cameras under the limitation of communication capacity2003
- Counting people from multiple cameras2003
- Recognizing human action in time-sequential images using hidden Markov model2003
- Recognizing temporal trajectories using the condensation algorithm2002
- Multiple-human tracking using multiple cameras2002
- Integrated Person Tracking Using Stereo, Color, and Pattern DetectionInternational Journal of Computer Vision, 2000
- W/sup 4/: real-time surveillance of people and their activitiesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Robust tracking of position and velocity with Kalman snakesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- A probabilistic exclusion principle for tracking multiple objects1999
- Tracking human motion in structured environments using a distributed-camera systemIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999