A Real-Time Mobile Robotic System for Crack Detection in Construction Using Two-Stage Deep Learning
Open Access
Abstract
The deterioration of civil infrastructure poses a significant threat to public safety, yet conventional manual inspections remain subjective, labor-intensive, and constrained by accessibility. To address these challenges, this paper presents a real-time robotic inspection system that integrates deep learning perception and autonomous navigation. The proposed framework employs a two-stage neural network: a U-Net for initial segmentation followed by a Pix2Pix conditional generative adversarial network (GAN) that utilizes adversarial residual learning to refine boundary accuracy and suppress false positives. When deployed on an Unmanned Ground Vehicle (UGV) equipped with an RGB-D camera and LiDAR, this framework enables simultaneous automated crack detection and collision-free autonomous navigation. Evaluated on the CrackSeg9k dataset, the two-stage model achieved a mean Intersection over Union (mIoU) of 73.9 ± 0.6% and an F1-score of 76.4 ± 0.3%. Beyond benchmark testing, the robotic system was further validated through simulation, laboratory experiments, and real-world campus hallway tests, successfully detecting micro-cracks as narrow as 0.3 mm. Collectively, these results demonstrate the system’s potential for robust, autonomous, and field-deployable infrastructure inspection.Keywords
This publication has 45 references indexed in Scilit:
- A survey on crack detection in concrete surface using image processing and machine learningJournal of Building Pathology and Rehabilitation, 2023
- Unsupervised domain adaptation for crack detectionAutomation in Construction, 2023
- CrackSeg9k: A Collection and Benchmark for Crack Segmentation Datasets and Frameworks2023
- Recent advancements of robotics in constructionAutomation in Construction, 2022
- Semantic segmentation of cracks: Data challenges and architectureAutomation in Construction, 2022
- Indoor Navigation System Using the Fetch Robot2019
- Computer vision-based concrete crack detection using U-net fully convolutional networksAutomation in Construction, 2019
- A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructureAdvanced Engineering Informatics, 2015
- Medical Image Computing and Computer-Assisted Intervention -- MICCAI 20152015
- Introduction2012