Automatic detection of falling hazard from surveillance videos based on computer vision and building information modeling
- 17 February 2022
- journal article
- research article
- Published by Taylor & Francis in Structure and Infrastructure Engineering
- Vol. 18 (7) , 1049-1063
Abstract
In construction sites, safety issue has always been a threatening risk that must be taken seriously. In order to improve the safety management capability of construction site, this paper establishes a construction site fall hazard management system. This system takes computer vision instead of sensor systems as an information exchange bridge between the physical construction site and the virtual model. The main contribution of this paper is to propose a deep learning-based approach to achieve bi-directional information exchange from physical construction sites to digital models. To train the deep learning model, this paper builds a dataset containing approximately 4000 images from multiple sources to detect on-site safety risks. This paper also proposes a method for acquiring coordinates of workers and risk sources, then establishes an automated safety management framework based on the real-time locations of risk sources and workers. The effectiveness of this safety management framework is verified through a case study comparing the differences between safety officers and the automated system. In addition, the method proposed in this paper integrating building information modeling (BIM) with the real construction process, achieving bi-directional coordination between the digital level and the physical level, providing data basis for intelligent construction.Keywords
Funding Information
- National Key R&D Program of China (2018YFD1100905)
This publication has 31 references indexed in Scilit:
- Case Study of BIM and Cloud–Enabled Real-Time RFID Indoor Localization for Construction Management ApplicationsJournal of Construction Engineering and Management, 2016
- Fast R-CNN2015
- Fast and scalable 3D cyber-physical modeling for high-precision mobile augmented reality systemsPersonal and Ubiquitous Computing, 2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiersAdvanced Engineering Informatics, 2013
- Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colorsAutomation in Construction, 2013
- Building Information Modeling (BIM) and Safety: Automatic Safety Checking of Construction Models and SchedulesAutomation in Construction, 2013
- Safety4Site Commitment to Enhance Jobsite Safety Management and PerformanceJournal of Construction Engineering and Management, 2012
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000