Real-time pedestrian pose estimation, tracking and localization for social distancing
Open Access
- 5 December 2022
- journal article
- research article
- Published by Springer Nature in Machine Vision and Applications
- Vol. 34 (1) , 1-17
Abstract
The corona virus pandemic has introduced limitations which were previously not a cause for concern. Chief among them are wearing face masks in public and constraints on the physical distance between people as an effective measure to reduce the virus spread. Visual surveillance systems, which are common in urban environments and initially commissioned for security surveillance, can be re-purposed to help limit the spread of COVID-19 and prevent future pandemics. In this work, we propose a novel integration technique for real-time pose estimation and multiple human tracking in a pedestrian setting, primarily for social distancing, using CCTV camera footage. Our technique promises a sizeable increase in processing speed and improved detection in very low-resolution scenarios. Using existing surveillance systems, pedestrian pose estimation, tracking and localization for social distancing (PETL4SD) is proposed for measuring social distancing, which combines the output of multiple neural networks aided with fundamental 2D/3D vision techniques. We leverage state-of-the-art object and pose estimation algorithms, combining their strengths, for increase in speed and improvement in detections. These detections are then tracked using a bespoke version of the FASTMOT algorithm. Temporal and analogous estimation techniques are used to deal with occlusions when estimating posture. Projective geometry along with the aforementioned posture tracking is then used to localize the pedestrians. Inter-personal distances are calculated and locally inspected to detect possible violations of the social distancing rules. Furthermore, a “smart violations detector” is employed which estimates if people are together based on their current actions and eliminates false social distancing violations within groups. Finally, distances are intuitively visualized with the right perspective. All implementation is in real time and is performed on Python. Experimental results are provided to validate our proposed method quantitatively and qualitatively on public domain datasets using only a single CCTV camera feed as input. Our results show our technique to outperform the baseline in speed and accuracy in low-resolution scenarios. The code of this work will be made publicly available on GitHub at https://github.com/bilalze/PETL4SD.Keywords
Funding Information
- National Science Foundation (1827505)
- Office of the Director of National Intelligence (HHM402-19-1- 0003, HHM402-18-1-0007)
This publication has 22 references indexed in Scilit:
- OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity FieldsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
- PifPaf: Composite Fields for Human Pose Estimation2019
- Simple online and realtime tracking with a deep association metric2017
- Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Camera Calibration2012
- Stable multi-target tracking in real-time surveillance video2011
- PETS2009: Dataset and challenge2009
- COMPUTING THE FRÉCHET DISTANCE BETWEEN TWO POLYGONAL CURVESInternational Journal of Computational Geometry & Applications, 1995
- Good features to track1994