Pedestrian Behavior Modeling From Stationary Crowds With Applications to Intelligent Surveillance
Authors:
- 11 July 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 25 (9) , 4354-4368
Abstract
Pedestrian behavior modeling and analysis is important for crowd scene understanding and has various applications in video surveillance. Stationary crowd groups are a key factor influencing pedestrian walking patterns but was mostly ignored in the literature. It plays different roles for different pedestrians in a crowded scene and can change over time. In this paper, a novel model is proposed to model pedestrian behaviors by incorporating stationary crowd groups as a key component. Through inference on the interactions between stationary crowd groups and pedestrians, our model can be used to investigate pedestrian behaviors. The effectiveness of the proposed model is demonstrated through multiple applications, including walking path prediction, destination prediction, personality attribute classification, and abnormal event detection. To evaluate our model, two large pedestrian walking route datasets are built. The walking routes of around 15 000 pedestrians from two crowd surveillance videos are manually annotated. The datasets will be released to the public and benefit future research on pedestrian behavior analysis and crowd scene understanding.Keywords
Funding Information
- Ph.D. Programs Foundation of China (20130185120039)
- Hong Kong Innovation and Technology Support Programme (ITS/221/13FP)
- National Natural Science Foundation of China (61371192, 61301269)
- General Research Fund through the Research Grants Council, Hong Kong (CUHK14206114, CUHK14205615, CUHK419412, CUHK14203015)
This publication has 48 references indexed in Scilit:
- Trajectory Analysis and Semantic Region Modeling Using Nonparametric Hierarchical Bayesian ModelsInternational Journal of Computer Vision, 2011
- How simple rules determine pedestrian behavior and crowd disastersProceedings of the National Academy of Sciences, 2011
- The Walking Behaviour of Pedestrian Social Groups and Its Impact on Crowd DynamicsPLOS ONE, 2010
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Group Dynamics2009
- Behavioral Priors for Detection and Tracking of Pedestrians in Video SequencesInternational Journal of Computer Vision, 2006
- Agent-based modeling: Methods and techniques for simulating human systemsProceedings of the National Academy of Sciences, 2002
- A fast marching level set method for monotonically advancing fronts.Proceedings of the National Academy of Sciences, 1996
- Novel Type of Phase Transition in a System of Self-Driven ParticlesPhysical Review Letters, 1995
- Social force model for pedestrian dynamicsPhysical Review E, 1995