Pavement Image Enhancement in Pixel-Wise Based on Multi-Level Semantic Information
- 16 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (12) , 15077-15091
Abstract
The detection of sealed cracks in pavement images can be complicated by the presence of objects on the pavement that have similar morphology or texture to cracks, leading to false positive results. To address this issue, this paper proposes a High Resolution-Pixel to Pixel (HR-Pix2Pix) pavement distress image enhancement algorithm. The algorithm improves the proportion of effective semantics by reducing the semantic interference caused by pseudo pavement distress such as pavement stains, brake marks, and shadows. The proposed HR-Pix2Pix generative adversarial neural network involves a novel generator architecture for fusing multi-level semantic features. The generator is capable to automatically locate the pseudo-distress in the image and fill (generate) the region as normal pavement texture with reference to the pavement texture surrounding the pseudo-distress. To further improve the quality of the semantic distribution-enhanced images, a hybrid loss function is designed and used to train the network. The results of the study show that by using HR-Pix2Pix enhanced images for sealed crack detection can significantly reduce false detections and improve the accuracy of the detection, consequently.Keywords
Funding Information
- National Natural Science Foundation of China (52108395, 51978071)
- Post-Doctoral Science Foundation of China (2022M710482)
- Key Projects of the Shaanxi Provincial Department of Science and Technology (2022JBGS3-08)
This publication has 42 references indexed in Scilit:
- Sealed-Crack Detection Algorithm Using Heuristic Thresholding ApproachJournal of Computing in Civil Engineering, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Co-location decision tree for enhancing decision-making of pavement maintenance and rehabilitationTransportation Research Part C: Emerging Technologies, 2012
- Inpainting with image patches for compressionJournal of Visual Communication and Image Representation, 2012
- Image Inpainting Based on Adaptive Total Variation ModelIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2011
- Patch-guided facial image inpainting by shape propagationJournal of Zhejiang University-SCIENCE A, 2009
- Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)Applied and Computational Harmonic Analysis, 2005
- Simultaneous total variation image inpainting and blind deconvolutionInternational Journal of Imaging Systems and Technology, 2005
- Video quality assessment based on structural distortion measurementSignal Processing: Image Communication, 2004
- An Image Inpainting Technique Based on the Fast Marching MethodJournal of Graphics Tools, 2004