Simultaneous pixel-level concrete defect detection and grouping using a fully convolutional model
- 14 January 2021
- journal article
- research article
- Published by SAGE Publications in Structural Health Monitoring
- Vol. 20 (4) , 2199-2215
Abstract
Deep learning techniques have attracted significant attention in the field of visual inspection of civil infrastructure systems recently. Currently, most deep learning-based visual inspection techniques utilize a convolutional neural network to recognize surface defects either by detecting a bounding box of each defect or classifying all pixels on an image without distinguishing between different defect instances. These outputs cannot be directly used for acquiring the geometric properties of each individual defect in an image, thus hindering the development of fully automated structural assessment techniques. In this study, a novel fully convolutional model is proposed for simultaneously detecting and grouping the image pixels for each individual defect on an image. The proposed model integrates an optimized mask subnet with a box-level detection network, where the former outputs a set of position-sensitive score maps for pixel-level defect detection and the latter predicts a bounding box for each defect to group the detected pixels. An image dataset containing three common types of concrete defects, crack, spalling and exposed rebar, is used for training and testing of the model. Results demonstrate that the proposed model is robust to various defect sizes and shapes and can achieve a mask-level mean average precision (mAP) of 82.4% and a mean intersection over union (mIoU) of 75.5%, with a processing speed of about 10 FPS at input image size of 576 × 576 when tested on an NVIDIA GeForce GTX 1060 GPU. Its performance is compared with the state-of-the-art instance segmentation network Mask R-CNN and the semantic segmentation network U-Net. The comparative studies show that the proposed model has a distinct defect boundary delineation capability and outperforms the Mask R-CNN and the U-Net in both accuracy and speed.Keywords
This publication has 34 references indexed in Scilit:
- Review of Robotic Infrastructure Inspection SystemsJournal of Infrastructure Systems, 2017
- Deep Learning‐Based Crack Damage Detection Using Convolutional Neural NetworksComputer-Aided Civil and Infrastructure Engineering, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Bridge Information Modeling for Inspection and EvaluationJournal of Bridge Engineering, 2016
- Deep learningNature, 2015
- A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructureAdvanced Engineering Informatics, 2015
- Concrete Crack Detection by Multiple Sequential Image FilteringComputer-Aided Civil and Infrastructure Engineering, 2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Analysis of Edge-Detection Techniques for Crack Identification in BridgesJournal of Computing in Civil Engineering, 2003