A Deeply Supervised Convolutional Neural Network for Pavement Crack Detection With Multiscale Feature Fusion
- 15 March 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 33 (9) , 4890-4899
Abstract
Automatic crack detection is vital for efficient and economical road maintenance. With the explosive development of convolutional neural networks (CNNs), recent crack detection methods are mostly based on CNNs. In this article, we propose a deeply supervised convolutional neural network for crack detection via a novel multiscale convolutional feature fusion module. Within this multiscale feature fusion module, the high-level features are introduced directly into the low-level features at different convolutional stages. Besides, deep supervision provides integrated direct supervision for convolutional feature fusion, which is helpful to improve model convergency and final performance of crack detection. Multiscale convolutional features learned at different convolution stages are fused together to robustly represent cracks, whose geometric structures are complicated and hardly captured by single-scale features. To demonstrate its superiority and generalizability, we evaluate the proposed network on three public crack data sets, respectively. Sufficient experimental results demonstrate that our method outperforms other state-of-the-art crack detection, edge detection, and image segmentation methods in terms of F1-score and mean IU.Keywords
Funding Information
- National Natural Science Foundation of China (61701060)
This publication has 34 references indexed in Scilit:
- Ongoing tests and improvements of the MPS algorithm for the automatic crack detection within grey level pavement images2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path SelectionIEEE Transactions on Intelligent Transportation Systems, 2016
- Automatic Road Crack Detection Using Random Structured ForestsIEEE Transactions on Intelligent Transportation Systems, 2016
- Deep Neural Network for Structural Prediction and Lane Detection in Traffic SceneIEEE Transactions on Neural Networks and Learning Systems, 2016
- Holistically-Nested Edge Detection2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep ArchitecturesIEEE Transactions on Neural Networks and Learning Systems, 2014
- Concrete Crack Detection by Multiple Sequential Image FilteringComputer-Aided Civil and Infrastructure Engineering, 2011