Integration of AR and deep learning–based image classification using CNN for construction project monitoring
Authors:
Open Access
- 21 January 2026
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1)
Abstract
With manual update, progress monitoring of a construction project is notably challenging due to its labor-intensive and time-consuming nature. The issue of manual update has been proposed to be alleviated by automatic update, but most existing AI-based progress tracking approaches are based on counting the elements finished. As a result, they cannot accurately reflect actual progress status to the project management. This research aims to develop a system that updates the progress of the construction project by effectively identifying both the construction category and operational stage. It is achieved by systematically integrating the techniques of Augmented Reality (AR) and deep learning–based image classification with convolutional neural networks (CNNs). The proposed scheme enables real-time data capture, facilitating comprehensive progress evaluation across multiple project locations. Its effectiveness is demonstrated using a case study of an interior finishing project for a building in Tamkang University, Taiwan. It reveals that the proposed system accurately identifies the construction category and operational stage based on the materials applied, enabling precise tracking of the progress. The results confirm that the proposed scheme significantly enhances the accuracy in construction progress monitoring, avoiding manual inspection and minimizing discrepancies between the planned and actual progress.Keywords
This publication has 40 references indexed in Scilit:
- End-to-end point cloud-based segmentation of building members for automating dimensional quality controlAdvanced Engineering Informatics, 2023
- Improving progress monitoring by fusing point clouds, semantic data and computer visionAutomation in Construction, 2020
- Semi-automatic geometric digital twinning for existing buildings based on images and CAD drawingsAutomation in Construction, 2020
- Bridge construction progress monitoring using lidar and 4D design modelsAutomation in Construction, 2020
- Impact of augmented reality and spatial cognition on assembly in constructionAutomation in Construction, 2019
- Data acquisition technologies for construction progress trackingAutomation in Construction, 2016
- Automated construction progress measurement using a 4D building information model and 3D dataAutomation in Construction, 2013
- Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniquesAutomation in Construction, 2011
- Error modeling for an untethered ultra-wideband system for construction indoor asset trackingAutomation in Construction, 2010
- Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in constructionAdvanced Engineering Informatics, 2010