WeatherRemover: All-in-One Adverse Weather Removal With Multiscale Feature Map Compression
- 14 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Artificial Intelligence
- Vol. 7 (5) , 2980-2994
Abstract
Photographs taken in adverse weather conditions often suffer from blurriness, occlusion, and low brightness due to interference from rain, snow, and fog. These issues can significantly hinder the performance of subsequent computer vision tasks, making the removal of weather effects a crucial step in image enhancement. Existing methods primarily target specific weather conditions, with only a few capable of handling multiple weather scenarios. However, mainstream approaches often overlook performance considerations, resulting in large parameter sizes, long inference times, and high memory costs. In this study, we introduce the WeatherRemover model, designed to enhance the restoration of images affected by various weather conditions while balancing performance. Our model adopts a UNet-like structure with a gating mechanism and a multi-scale pyramid vision Transformer. It employs channel-wise attention derived from convolutional neural networks to optimize feature extraction, while linear spatial reduction helps curtail the computational demands of attention. The gating mechanisms, strategically placed within the feed-forward and downsampling phases, refine the processing of information by selectively addressing redundancy and mitigating its influence on learning. This approach facilitates the adaptive selection of essential data, ensuring superior restoration and maximizing efficiency. Additionally, our lightweight model achieves an optimal balance between restoration quality, parameter efficiency, computational overhead, and memory usage, distinguishing it from other multi-weather models, thereby meeting practical application demands effectively. The source code is available at https://github.com/RICKand-MORTY/WeatherRemover.Keywords
All Related Versions
Funding Information
- Shenzhen Medical Research Fund (C2401036)
- Shenzhen Medical Research Fund (20232ABC03A25)
- Guangxi Science and Technology Program (FN2504240022)
- Guangxi Key R&D Project (AB24010167)
- Basic and Applied Basic Research Foundation of Guangdong Province (2025A1515011617)
This publication has 34 references indexed in Scilit:
- Iterative image rain removal network using consecutive residual long short-term memoryNeurocomputing, 2024
- PVT v2: Improved baselines with pyramid vision transformerComputational Visual Media, 2022
- End-to-End Object Detection with Transformers2020
- Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning2019
- Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restoration2019
- Attentive Generative Adversarial Network for Raindrop Removal from A Single Image2018
- Deep Residual Learning for Image Recognition2016
- Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Scope of validity of PSNR in image/video quality assessmentElectronics Letters, 2008