Semi-Automated Visual Quality Control Inspection During Construction or Renovation of Railways Using Deep Learning Techniques and Augmented Reality Visualization
Open Access
- 1 January 2023
- book chapter
- Published by Firenze University Press
- p. 865-876
Abstract
The construction industry stands to greatly benefit from the technological advancements in deep learning and computer vision, which can automate time-consuming tasks such as quality control. In this paper, we introduce a framework that incorporates two advanced tools - the Visual Quality Control (VQC) tool and the Digital Twin visualization with Augmented Reality (DigiTAR) tool - to perform semi-automated visual quality control in the construction site during the execution phase of the project. The VQC tool is a backend service that detects potential defects on images captured on-site using the Mask R-CNN algorithm trained on annotated images of concrete and railway defects. The surveyor, aided by the Augmented Reality (AR) technology through the DigiTAR tool, can in-situ confirm/reject the detected defects and propose remedial actions. All the quality control results are recorded in the relevant BIM model and can be viewed on-site overlaid on the physical construction elements. This solution offers a semi-automated visual inspection that can speed up and simplify the quality control process, especially in case of large linear infrastructures, illustrating the added value of AR-based applications in Digital TwinsKeywords
This publication has 26 references indexed in Scilit:
- Automated crack detection and crack depth prediction for reinforced concrete structures using deep learningConstruction and Building Materials, 2023
- Rebar inspection integrating augmented reality and laser scanningAutomation in Construction, 2022
- Automatic defect detection and segmentation of tunnel surface using modified Mask R-CNNMeasurement, 2021
- Defect detection method for rail surface based on line-structured lightMeasurement, 2020
- A collaborative augmented reality annotation tool for the inspection of prefabricated buildingsMultimedia Tools and Applications, 2019
- Instance-level recognition and quantification for concrete surface bughole based on deep learningAutomation in Construction, 2019
- Railway track fastener defect detection based on image processing and deep learning techniques: A comparative studyEngineering Applications of Artificial Intelligence, 2019
- Implementation of augmented reality for segment displacement inspection during tunneling constructionAutomation in Construction, 2017
- A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented realityAutomation in Construction, 2014
- LabelMe: A Database and Web-Based Tool for Image AnnotationInternational Journal of Computer Vision, 2007