Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detection
Authors:
- Deepak Babu SamDSDeepak Babu Sam
- Skand Vishwanath PeriSPSkand Vishwanath Peri
- Mukuntha Narayanan SundararamanMSMukuntha Narayanan Sundararaman
- Amogh KamathAKAmogh Kamath
- Venkatesh Babu RadhakrishnanVRVenkatesh Babu Radhakrishnan
- 18 February 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 43 (01628828) , 1
Abstract
We introduce a detection framework for dense crowd counting and eliminate the need for the prevalent density regression paradigm. Typical counting models predict crowd density for an image as opposed to detecting every person. These regression methods, in general, fail to localize persons accurate enough for most applications other than counting. Hence, we adopt an architecture that locate s every person in the crowd, size s the spotted heads with bounding box and then count s them. Compared to normal object or face detectors, there exist certain unique challenges in designing such a detection system. Some of them are direct consequences of the huge diversity in dense crowds along with the need to predict boxes contiguously. We solve these issues and develop our LSC-CNN model, which can reliably detect heads of people across sparse to dense crowds. LSC-CNN employs a multi-column architecture with top-down feature modulation to better resolve persons and produce refined predictions at multiple resolutions. Interestingly, the proposed training regime requires only point head annotation, but can estimate approximate size information of heads. We show that LSC-CNN not only has superior localization than existing density regressors, but outperforms in counting as well. The code for our approach is available at https://github.com/val-iisc/lsc-cnn .Keywords
All Related Versions
Funding Information
- Dept. of Science and Technology Govt. of India (SB/S3/EECE/0127/2015)
This publication has 35 references indexed in Scilit:
- From Facial Parts Responses to Face Detection: A Deep Learning Approach2015
- Extremely Overlapping Vehicle Counting2015
- Cross-scene crowd counting via deep convolutional neural networks2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Detecting Humans in Dense Crowds Using Locally-Consistent Scale Prior and Global Occlusion ReasoningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Multi-source Multi-scale Counting in Extremely Dense Crowd Images2013
- Detecting Pedestrians Using Patterns of Motion and AppearanceInternational Journal of Computer Vision, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004