Real-Time Monitoring of Personal Protective Equipment Compliance in Surveillance Cameras
Open Access
- 28 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 121882-121895
Abstract
Worker safety in the industrial, construction, and energy sectors is the primary concern of governments, organizations, and project managers. Traditional monitoring systems are tedious, laborious, subjective, expensive, and inaccurate. Therefore, the development of automated and accurate systems for real-time monitoring and detecting personal protective equipment (PPE) compliance is urgently needed. This study provides valuable insights and contributions to the field of workers’ safety in the industrial, construction, and energy sectors. It aims to evaluate the potential contribution of providing a robust and accurate real-time PPE compliance monitoring system using state-of-the-art deep learning techniques with real-world videos collected from surveillance cameras. Furthermore, it presents a systematic framework for developing, evaluating, and selecting the most suitable model for real-world applications, starting from data collection and ending with system deployment and maintenance. To the best of our knowledge, the collected dataset in this work is the largest PPE’s dataset, with approximately 7.7 million labels representing different PPEs in 386,011 video frames collected from several surveillance cameras. The techniques adopted to generate different models and evaluated for PPE are CenterNet, Vision Transformer, and YOLOv7. Moreover, an optimized real-time inference engine is developed leveraging the high-computing power of GPUs in the system. The experimental results demonstrate that the models developed using YOLO are the most accurate and can be better generalized to detect PPE compliance in new working environments, achieving mean average precisions of 92.36% and 66.70% on Test Set I and Test Set II , respectively. In addition, they achieve real-time detection of PPE compliance.Keywords
Funding Information
- Saudi Data and AI Authority (SDAIA) and King Fahd University of Petroleum and Minerals (KFUPM)under the SDAIA-KFUPM Joint Research Center for Artificial Intelligence (JRC-AI-UCG-01)
This publication has 35 references indexed in Scilit:
- Contrastive-based YOLOv7 for personal protective equipment detectionNeural Computing and Applications, 2023
- Standardized use inspection of workers' personal protective equipment based on deep learningSafety Science, 2022
- Pose guided anchoring for detecting proper use of personal protective equipmentAutomation in Construction, 2021
- Towards on-site hazards identification of improper use of personal protective equipment using deep learning-based geometric relationships and hierarchical scene graphAutomation in Construction, 2021
- Deep learning for site safety: Real-time detection of personal protective equipmentAutomation in Construction, 2020
- Automatic detection of hardhats worn by construction personnel: A deep learning approach and benchmark datasetAutomation in Construction, 2019
- Real-Time Alarming, Monitoring, and Locating for Non-Hard-Hat Use in ConstructionJournal of Construction Engineering and Management, 2019
- Falls from heights: A computer vision-based approach for safety harness detectionAutomation in Construction, 2018
- Workforce location tracking to model, visualize and analyze workspace requirements in building information models for construction safety planningAutomation in Construction, 2015
- Mobile passive Radio Frequency Identification (RFID) portal for automated and rapid control of Personal Protective Equipment (PPE) on construction sitesAutomation in Construction, 2013