Automatic road crack detection and classification using multi-tasking faster RCNN
Authors:
- 16 December 2021
- journal article
- research article
- Published by SAGE Publications in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
- Vol. 41 (6) , 6615-6628
Abstract
Automatic road crack detection is a prominent challenging task, in view of that, a novel approach is proposed using multi-tasking Faster-RCNN to detect and classify road cracks. In this present study, we have collected the road images (a dataset of 19300 images) from the Outer Ring Road of Chennai, Tamil Nadu, India. The collected road images were pre-processed using various conventional image processing techniques to identify the ground-truth label of the bounding boxes for the cracks. We present a novel multi-tasking Faster-RCNN based approach using the Global Average Pooling(GAP) and Region of Interest (RoI) Align techniques to detect the road cracks. The RoI Align is used to avoid quantizing the stride. So that the information loss can be minimized and the bi-linear interpolation can be used to map the proposal to the input image. The resulting features from RoI Align are given as input to the GAP layer which drastically reduces the multi-dimension features into a single feature map. The output of the GAP layer is given to the fully connected layer for classification (softmax) and also to a regression model for predicting the crack location using a bounding box. F1-measure, precision, and recall were used to evaluate the results of classification and detection. The proposed model achieves the accuracy-97.97%, precision-99.12%, and recall-97.25% for classification using the MIT-CHN-ORR dataset. The experimental results show, that the proposed approach outperforms the other state-of-the-art methods.Keywords
This publication has 29 references indexed in Scilit:
- Automatic Road Crack Detection Using Random Structured ForestsIEEE Transactions on Intelligent Transportation Systems, 2016
- Image Segmentation Based on Sobel Edge Detection2016
- Robust edge detector using back propagation neural network with multi-thresholding2014
- Improved canny edge detector in various color spaces2014
- Optimization of Laplace of Gaussian (LoG) filter for enhanced edge detection: A new approach2014
- Probe into Image Segmentation Based on Sobel Operator and Maximum Entropy Algorithm2012
- CrackTree: Automatic crack detection from pavement imagesPattern Recognition Letters, 2012
- An edge detection technique using the facet model and parameterized relaxation labelingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- On the edge location error for local maximum and zero-crossing edge detectorsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
- Adaptive histogram equalization and its variationsComputer Vision, Graphics, and Image Processing, 1987