Tracking with local spatio-temporal motion patterns in extremely crowded scenes
Authors:
- 1 June 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 693-700
Abstract
Tracking individuals in extremely crowded scenes is a challenging task, primarily due to the motion and appearance variability produced by the large number of people within the scene. The individual pedestrians, however, collectively form a crowd that exhibits a spatially and temporally structured pattern within the scene. In this paper, we extract this steady-state but dynamically evolving motion of the crowd and leverage it to track individuals in videos of the same scene. We capture the spatial and temporal variations in the crowd's motion by training a collection of hidden Markov models on the motion patterns within the scene. Using these models, we predict the local spatio-temporal motion patterns that describe the pedestrian movement at each space-time location in the video. Based on these predictions, we hypothesize the target's movement between frames as it travels through the local space-time volume. In addition, we robustly model the individual's unique motion and appearance to discern them from surrounding pedestrians. The results show that we may track individuals in scenes that present extreme difficulty to previous techniques.Keywords
This publication has 17 references indexed in Scilit:
- Tracking in unstructured crowded scenes2009
- Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models2009
- Tracking Large Variable Numbers of Objects in Clutter2007
- Unsupervised Bayesian Detection of Independent Motion in Crowds2006
- Probabilistic tracking of motion boundaries with spatiotemporal predictions2005
- Space-Time Behavior Based Correlation2005
- Fast occluded object tracking by a robust appearance filterIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Performance of optical flow techniquesInternational Journal of Computer Vision, 1994
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951