Rethinking Lightweight Convolutional Neural Networks for Efficient and High-Quality Pavement Crack Detection
- 17 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (1) , 237-250
Abstract
Pixel-level road crack detection has always been a challenging task in intelligent transportation systems. Due to the external environments, such as weather, light, and other factors, pavement cracks often present low contrast, poor continuity, and different sizes in length and width. However, most of the existing studies pay less attention to crack data under different situations. Meanwhile, recent algorithms based on deep convolutional neural networks (DCNNs) have promoted the development of cutting-edge models for crack detection. Nevertheless, they usually focus on complex models for good performance, but ignore detection efficiency in practical applications. In this article, to address the first issue, we collected two new databases (i.e. Rain365 and Sun520) captured on rainy and sunny days respectively, which enrich the data of the open source community. For the second issue, we reconsider how to improve detection efficiency with excellent performance, and then propose our lightweight encoder-decoder architecture termed CarNet. Specifically, we introduce a novel olive-shaped structure for the encoder network, a lightweight multi-scale block and a new up-sampling method in the decoder network. Numerous experiments show that our model can better balance detection performance and efficiency compared with previous models. Especially, on the Sun520 dataset, our CarNet significantly advances the state-of-the-art performance with ODS F-score from 0.488 to 0.514. Meanwhile, it does so with an improved detection speed (104 frames per second) which is orders of magnitude faster than some recent DCNNs-based algorithms specially designed for crack detection.Keywords
Funding Information
- National Natural Science Foundation of China (12071458, 71731009, 61702099)
- University of International Business and Economics (UIBE) Excellent Young Scholar Project (21YQ10)
- Scientific Research Laboratory of Artificial Intelligence (AI) Technology and Applications, University of International Business and Economics
- Science and Technology Plan Project in Basic Public Welfare class of Shaoxing city (2022A11002)
This publication has 52 references indexed in Scilit:
- BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic SegmentationInternational Journal of Computer Vision, 2021
- A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image DomainsInternational Journal of Computer Vision, 2020
- Curriculum Semi-supervised Segmentation2019
- ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design2018
- BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation2018
- Detection of Curved Lines with B-COSFIRE Filters: A Case Study on Crack Delineation2017
- Richer Convolutional Features for Edge Detection2017
- Deep Residual Learning for Image Recognition2016
- A systematic comparison between visual cues for boundary detectionVision Research, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015