GBPG-Net: Global Background Prior-Guided Rain and Snow Image Restoration
- 24 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (10) , 18448-18462
Abstract
The aim of image restoration in the presence of rain and snow effects is to eliminate these disturbances while retaining the underlying background structure. Most existing methods tend to directly learn the mapping from corrupted images to clean ones, often resulting in residual rain or snow artifacts and compromised background structures. In this work, both theoretical analysis and experimental findings confirm the robustness of the hue channel in HSV color space to rain and snow disturbances, even when extracted from corrupted images. Motivated by this insight, we propose to leverage the global clean background cues inherent in the hue channel to guide the network in preserving the image background structure and removing interference. To this end, we introduce the global background prior-guided network (GBPG-Net) for restoring rain and snow-affected images, which employs a triangular formation to facilitate continuous interaction and updating of the global background prior (GBP) with the image feature within the GBPG-unit, resulting in improved interference removal and background structure preservation. Specifically, the GBPG-Net incorporates the global clean background prior injector (GCBPI) to inject the GBP into the network. Subsequently, the prior-guided local detail excavation (PGLDE) module, built on GCBPI, further refines interference removal and structure preservation to process local details intricately. Finally, the prior-guided local-global aggregation (PGLGA) module aggregates global background features with local detailed features, enabling the network to better understand the overall content and subtle interference for more accurate reconstruction. Quantitative and qualitative evaluations on synthetic and real datasets demonstrate the effectiveness of the proposed GBPG-Net in deraining and desnowing tasks, highlighting its advantages over existing methods. The code and supplementary documentation are available at https://github.com/liux520/GBPG-NetKeywords
Funding Information
- National Natural Science Foundation of China (62171304)
- Natural Science Foundation of Sichuan Province (2024NSFSC1423)
- Cooperation Science and Technology Project of Sichuan University and Dazhou City (2022CDDZ-09)
- Young Faculty Technology Innovation Capacity Enhancement Program of Sichuan University (2024SCUQJTX025)
- Open Project of Anhui Provincial Key Laboratory of Multimodal Cognitive Computation (MMC202419)
This publication has 57 references indexed in Scilit:
- A prior-guided deep network for real image denoising and its applicationsKnowledge-Based Systems, 2022
- JSTASR: Joint Size and Transparency-Aware Snow Removal Algorithm Based on Modified Partial Convolution and Veiling Effect Removal2020
- Depth-Attentional Features for Single-Image Rain Removal2019
- Progressive Image Deraining Networks: A Better and Simpler Baseline2019
- Image Super-Resolution Using Very Deep Residual Channel Attention Networks2018
- Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining2018
- Density-Aware Single Image De-raining Using a Multi-stream Dense Network2018
- Deep Joint Rain Detection and Removal from a Single Image2017
- Removing Rain from Single Images via a Deep Detail Network2017
- Rain Streak Removal Using Layer Priors2016