Video-Based Motion Trajectory Forecasting Method for Proactive Construction Safety Monitoring Systems
Authors:
- 1 November 2020
- journal article
- research article
- Published by American Society of Civil Engineers (ASCE) in Journal of Computing in Civil Engineering
- Vol. 34 (6) , 04020041
Abstract
Falls, struck-bys, and caught-in/betweens are among the most common types of fatal accidents on construction sites. Despite their significance, the majority of today’s accident prevention programs react passively to situations in which workers or equipment enter predefined unsafe zones. To support systems that proactively prevent these accidents, this paper presents a path prediction model for workers and equipment. The model leverages the extracted video frames to predict upcoming worker and equipment motion trajectories on construction sites. Specifically, the model takes two-dimensional (2D) tracks of workers and equipment from visual data—based on computer vision methods for detection and tracking—and uses a long short-term memory (LSTM) encoder-decoder followed by a mixture density network (MDN) to predict their locations. A multihead prediction module is introduced to predict locations at different future times. The method is validated on an existing dataset, TrajNet, and a new dataset of 105 high-definition videos recorded over 30 days from a real-world construction site. On the TrajNet dataset, the proposed model significantly outperforms Social LSTM. On the new dataset, the presented model outperforms conventional time-series models and achieves average localization errors of 7.30, 12.71, and 24.22 pixels for 10, 20, and 40 future steps, respectively. The benefits and limitations of the method to worker and equipment path prediction are discussed.Keywords
This publication has 58 references indexed in Scilit:
- Computer vision techniques for construction safety and health monitoringAdvanced Engineering Informatics, 2015
- Construction performance monitoring via still images, time-lapse photos, and video streams: Now, tomorrow, and the futureAdvanced Engineering Informatics, 2015
- Proactive Construction Safety Control: Measuring, Monitoring, and Responding to Safety Leading IndicatorsJournal of Construction Engineering and Management, 2013
- Leading indicators of construction safety performanceSafety Science, 2013
- Activity Forecasting2012
- A proactive system for real-time safety management in construction sitesAutomation in Construction, 2011
- Automated vision tracking of project related entitiesAdvanced Engineering Informatics, 2011
- Safety risk interactions among highway construction work tasksConstruction Management and Economics, 2011
- Autonomous pro-active real-time construction worker and equipment operator proximity safety alert systemAutomation in Construction, 2010
- Construction Safety Risk MitigationJournal of Construction Engineering and Management, 2009