Deep learning-based concrete defects classification and detection using semantic segmentation
Open Access
- 2 May 2023
- journal article
- research article
- Published by SAGE Publications in Structural Health Monitoring
- Vol. 23 (1) , 383-409
Abstract
Visual damage detection of infrastructure using deep learning (DL)-based computational approaches can facilitate a potential solution to reduce subjectivity yet increase the accuracy of the damage diagnoses and accessibility in a structural health monitoring (SHM) system. However, despite remarkable advances with DL-based SHM, the most significant challenges to achieving the real-time implication are the limited available defects image databases and the selection of DL networks depth. To address these challenges, this research has created a diverse dataset with concrete crack (4087) and spalling (1100) images and used it for damage condition assessment by applying convolutional neural network (CNN) algorithms. CNN-classifier models are used to identify different types of defects and semantic segmentation for labeling the defect patterns within an image. Three CNN-based models—Visual Geometry Group (VGG)19, ResNet50, and InceptionV3 are incorporated as CNN-classifiers. For semantic segmentation, two encoder-decoder models, U-Net and pyramid scene parsing network architecture are developed based on four backbone models, including VGG19, ResNet50, InceptionV3, and EfficientNetB3. The CNN-classifier models are analyzed on two optimizers—stochastic gradient descent (SGD), root mean square propagation (RMSprop), and learning rates—0.1, 0.001, and 0.0001. However, the CNN-segmentation models are analyzed for SGD and adaptive moment estimation, trained with three different learning rates—0.1, 0.01, and 0.0001, and evaluated based on accuracy, intersection over union, precision, recall, and F1-score. InceptionV3 achieves the best performance for defects classification with an accuracy of 91.98% using the RMSprop optimizer. For crack segmentation, EfficientNetB3-based U-Net, and for spalling segmentation, IncenptionV3-based U-Net model outperformed all other algorithms, with an F1-score of 95.66 and 89.43%, respectively.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada (ALLRP 555258 - 20)
This publication has 43 references indexed in Scilit:
- A texture‐Based Video Processing Methodology Using Bayesian Data Fusion for Autonomous Crack Detection on Metallic SurfacesComputer-Aided Civil and Infrastructure Engineering, 2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Going deeper with convolutions2015
- Synchrosqueezed wavelet transform-fractality model for locating, detecting, and quantifying damage in smart highrise building structuresSmart Materials and Structures, 2015
- Signal Processing Techniques for Vibration-Based Health Monitoring of Smart StructuresArchives of Computational Methods in Engineering, 2014
- Defect Detection in Reinforced Concrete Using Random Neural ArchitecturesComputer-Aided Civil and Infrastructure Engineering, 2014
- Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessmentsAdvanced Engineering Informatics, 2012
- Pseudospectra, MUSIC, and dynamic wavelet neural network for damage detection of highrise buildingsInternational Journal for Numerical Methods in Engineering, 2007
- Position‐Invariant Neural Network for Digital Pavement Crack AnalysisComputer-Aided Civil and Infrastructure Engineering, 2004
- Analysis of Edge-Detection Techniques for Crack Identification in BridgesJournal of Computing in Civil Engineering, 2003