Let You See in Haze and Sandstorm: Two-in-One Low-Visibility Enhancement Network
- 14 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-12
Abstract
Scattering particles (such as water vapor and dust) in the atmosphere excessively absorb and scatter light, which causes the image collected by imaging sensors with low visibility, low contrast, and color shifting, etc. This limitation hinders the development of vision-driven artificial intelligence applications, such as the intelligent traffic monitoring system (ITMS). To improve imaging quality in hazy and sandstorm conditions, this paper proposes a novel two-in-one low-visibility enhancement network (termed TOENet). Specifically, we take into account the changes in the histogram distributions of the red, green, and blue channels of the hazy and sandstorm images and present a multilayer perceptron (MLP)-based channel correlation extraction module (CCEM) to learn and reconstruct the correlation between the channels of low-visibility images. The multi-scale channel attention features generated by CCEM will be embedded into the backbone (i.e., the encoder-decoder network) of TOENet to extract additional latent feature information from low-visibility images. TOENet can achieve both dehazing and sandstorm enhancement through a single deep network model without incurring extra computational costs. Extensive experimental results demonstrate that the proposed TOENet outperforms several state-of-the-art methods on challenging datasets. Furthermore, the running time and object detection experiments indicate the practical benefits of our method for high-level visual task under low-visibility weathers in ITMS. The source code is available at https://github.com/YuanGao-YG/TOENet.Keywords
Funding Information
- Fundamental Research Funds for the Central Universities (225212002)
This publication has 45 references indexed in Scilit:
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- A Fast Single Image Haze Removal Algorithm Using Color Attenuation PriorIEEE Transactions on Image Processing, 2015
- Blind image quality evaluation using perception based features2015
- A retinex-based enhancing approach for single underwater image2014
- A fusion-based enhancing approach for single sandstorm image2014
- VSI: A Visual Saliency-Induced Index for Perceptual Image Quality AssessmentIEEE Transactions on Image Processing, 2014
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Contrast enhancement using brightness preserving bi-histogram equalizationIEEE Transactions on Consumer Electronics, 1997
- Adaptive histogram equalization and its variationsComputer Vision, Graphics, and Image Processing, 1987
- The Retinex Theory of Color VisionScientific American, 1977