Automatic Pixel-Level Crack Detection for Civil Infrastructure Using Unet++ and Deep Transfer Learning
Authors:
- 16 June 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (17) , 19165-19175
Abstract
In the practical applications of crack detection, traditional image processing based detection methods are faced with a lot of challenges, such as low level of intelligence, poor adaptability and so on. In this paper, an automatic pixel-level crack detection method based on deep transfer learning is proposed for engineering applications. The proposed detection method is composed of two stages: crack recognition and crack semantic segmentation, which makes it easy to meet the needs of efficient and reliable detection for large-scale collected images. The fine-tuned Vgg16 model in the first stage can accurately identify the crack images and avoid the computing cost for non-crack images in the further processing. The Unet++ model in the second stage provides a pixel-level semantic segmentation for crack images. Multifold knowledge based transfer learning and weighted loss function are proposed to improve the performance and generalization ability of the models. On 5 publicly available datasets, the proposed method achieved a mIoU of 84.62%. Tested on totally 8064 images with a resolution of 224×224, the proposed method achieved a mean detection speed of 8.1ms per image. Experiment results exhibit that the proposed method can effectively detect the pixel-level cracks. It provides an end-to-end deep learning method for large-scale crack detection for civil infrastructure. For the crack detection in complex scenes and the improvement of processing speed will be our next in-depth study.Keywords
This publication has 42 references indexed in Scilit:
- Deep Learning‐Based Crack Damage Detection Using Convolutional Neural NetworksComputer-Aided Civil and Infrastructure Engineering, 2017
- Supervised Deep Restricted Boltzmann Machine for Estimation of ConcreteACI Materials Journal, 2017
- An efficient and reliable coarse-to-fine approach for asphalt pavement crack detectionImage and Vision Computing, 2017
- Automatic crack detection from 2D images using a crack measure-based B-spline level set modelMultidimensional Systems and Signal Processing, 2016
- Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path SelectionIEEE Transactions on Intelligent Transportation Systems, 2016
- Inexpensive Multimodal Sensor Fusion System for Autonomous Data Acquisition of Road Surface ConditionsIEEE Sensors Journal, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Automatic Road Crack Detection Using Random Structured ForestsIEEE Transactions on Intelligent Transportation Systems, 2016
- The algorithm of accelerated cracks detection and extracting skeleton by direction chain code in concrete surface imageThe Imaging Science Journal, 2016
- Automatic Road Pavement Assessment with Image Processing: Review and ComparisonInternational Journal of Geophysics, 2011