Automated Pavement Crack Detection with Deep Learning Methods: What Are the Main Factors and How to Improve the Performance?
- 18 April 2023
- journal article
- research article
- Published by SAGE Publications in Transportation Research Record: Journal of the Transportation Research Board
- Vol. 2677 (10) , 311-323
Abstract
Recently, deep learning (DL) methods have been intensively studied in pavement distress detection research. To build an effective yet robust DL-based distress detection model, both the training data and DL model structure need to be carefully prepared. This paper discusses the main influencing factors that affect the performance of DL models in pavement distress detection and aims to explore possible ways to improve the model performance. An open-source pavement image dataset and three promising object detection methods were selected for model development and evaluation. A series of experiments were conducted with different settings of model structures and data manipulation. According to the experiment results, selection of detection methods, data size, and annotation consistency have significant impact on detection performance. DL models YOLO and Faster R-CNN were found to yield the same level of performance, while CenterNet notably underperformed on the test dataset. Distress classes with a larger number of instances were found to be able to yield better performances. With the new annotation data carefully marked up and verified by experienced pavement raters, the accuracy score using the F1 index was found to be 0.84, which was a very sound improvement compared with the 0.7 of the original annotation. Data augmentation methods were found to be able to significantly improve the detection accuracy. Based on the experiment results, we believe the focus should be placed on the development of high-quality training datasets and thin object detection methods in the future.Keywords
This publication has 10 references indexed in Scilit:
- Deep learning-based road damage detection and classification for multiple countriesAutomation in Construction, 2021
- Automated Detection and Classification of Pavement Distresses using 3D Pavement Surface Images and Deep LearningTransportation Research Record: Journal of the Transportation Research Board, 2021
- Pavement Image Datasets: A New Benchmark Dataset to Classify and Densify Pavement DistressesTransportation Research Record: Journal of the Transportation Research Board, 2020
- Automated Pavement Condition Surveys2019
- Automatic classification of pavement crack using deep convolutional neural networkInternational Journal of Pavement Engineering, 2018
- Evaluation Framework for Automated Pavement Distress Identification and Quantification ApplicationsTransportation Research Record: Journal of the Transportation Research Board, 2017
- Machine learning-based imaging system for surface defect inspectionInternational Journal of Precision Engineering and Manufacturing-Green Technology, 2016
- Automatic Road Crack Detection Using Random Structured ForestsIEEE Transactions on Intelligent Transportation Systems, 2016
- Evaluating Pavement Cracks with Bidimensional Empirical Mode DecompositionEURASIP Journal on Advances in Signal Processing, 2008
- Wavelet-Based Pavement Distress Image Edge Detection with À Trous AlgorithmTransportation Research Record: Journal of the Transportation Research Board, 2007