Real-World Non-Homogeneous Haze Removal by Sliding Self-Attention Wavelet Network
- 13 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (10) , 5470-5485
Abstract
In complex natural haze scenes, image haze removal still faces significant challenges in removing non-homogeneous and dense haze. The double complexity of haze distribution, on the one hand, is reflected in the interference of haze to the global image information, and on the other hand, it is reflected in the imbalance of image brightness and color caused by random haze distribution. In natural scenes with prominent edge and texture features, the above problems may cause severe degradation of image quality and performance of various tasks. Numerous studies on network learning show that the effect of haze removal is closely related to haze feature expression. Therefore, to improve the performance of dehazing, this paper proposes a sliding self-attention wavelet network. Specifically, we first design a sliding self-attention module to identify haze regions in images and capture rich haze-related feature information. Then, considering the uneven distribution of haze in images, discrete wavelet transform (DWT) and inverse transform (IDWT) are used for constructing a hierarchical encoder-decoder structure, which can fully use the multi-resolution characteristics of DWT, locally decompose feature maps of different scales, extract low and high-frequency information, and then gradually recover sharp edges and precise texture details from hazy images. Finally, to enable the proposed network to generate more realistic haze-free images on different complex haze scenes, we develop a DWT-based adversarial loss function to constrain the low and high-frequency components of generated images closer to the corresponding clear images. Experimental results on the relevant public benchmark datasets show that the proposed algorithm achieves favorable dehazing performance.Keywords
Funding Information
- Shenzhen Science and Technology Program (JCYJ20200109142612234)
- Basic and Applied Basic Research Foundation of Guangdong Province (2021A1515012313)
This publication has 54 references indexed in Scilit:
- Semantic Foggy Scene Understanding with Synthetic DataInternational Journal of Computer Vision, 2018
- AOD-Net: All-in-One Dehazing Network2017
- HazeRD: An outdoor scene dataset and benchmark for single image dehazing2017
- DehazeNet: An End-to-End System for Single Image Haze RemovalIEEE Transactions on Image Processing, 2016
- Dehazing Using Color-LinesACM Transactions on Graphics, 2014
- Making a “Completely Blind” Image Quality AnalyzerIEEE Signal Processing Letters, 2012
- BLIND CONTRAST ENHANCEMENT ASSESSMENT BY GRADIENT RATIOING AT VISIBLE EDGESImage Analysis and Stereology, 2008
- Visibility in bad weather from a single image2008
- The blur effect: perception and estimation with a new no-reference perceptual blur metric2007
- Polarization-based vision through hazeApplied Optics, 2003