From Handcrafted to Deep Features for Pedestrian Detection: A Survey
- 30 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 44 (9) , 4913-4934
Abstract
Pedestrian detection is an important but challenging problem in computer vision, especially in human-centric tasks. Over the past decade, significant improvement has been witnessed with the help of handcrafted features and deep features. Here we present a comprehensive survey on recent advances in pedestrian detection. First, we provide a detailed review of single-spectral pedestrian detection that includes handcrafted features based methods and deep features based approaches. For handcrafted features based methods, we present an extensive review of approaches and find that handcrafted features with large freedom degrees in shape and space have better performance. In the case of deep features based approaches, we split them into pure CNN based methods and those employing both handcrafted and CNN based features. We give the statistical analysis and tendency of these methods, where feature enhanced, part-aware, and post-processing methods have attracted main attention. In addition to single-spectral pedestrian detection, we also review multi-spectral pedestrian detection, which provides more robust features for illumination variance. Furthermore, we introduce some related datasets and evaluation metrics, and a deep experimental analysis. We conclude this survey by emphasizing open problems that need to be addressed and highlighting various future directions. Researchers can track an up-to-date list at https://github.com/JialeCao001/PedSurvey .Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2018AAA0102800)
- National Natural Science Foundation of China (61906131, 61632018)
- VR starting (2016-05543)
This publication has 247 references indexed in Scilit:
- Fast Feature Pyramids for Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Scene-Specific Pedestrian Detection for Static Video SurveillanceIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Selective Search for Object RecognitionInternational Journal of Computer Vision, 2013
- Crosstalk Cascades for Frame-Rate Pedestrian Detection2012
- Multiresolution Models for Object Detection2010
- SURF: Speeded Up Robust Features2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997