Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removal
- 6 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 34 (10577149) , 7422-7435
Abstract
Universal adverse weather removal (UAWR) seeks to address various weather degradations within a unified framework. Recent methods are inspired by prompt learning using pre-trained vision-language models (e.g., CLIP), leveraging degradation-aware prompts to facilitate weather-free image restoration, yielding significant improvements. In this work, we propose CyclicPrompt, an innovative cyclic prompt approach designed to enhance the effectiveness, adaptability, and generalizability of UAWR. CyclicPrompt comprises two key components: 1) a composite context prompt that integrates weather-related information and context-aware representations into the network to guide restoration. This prompt differs from previous methods by marrying learnable input-conditional vectors with weather-specific knowledge, thereby improving adaptability across various degradations. 2) The erase-and-paste mechanism, after the initial guided restoration, substitutes weather-specific knowledge with constrained restoration priors, inducing high-quality weather-free concepts into the composite prompt to further fine-tune the restoration process. Therefore, we can form a cyclic “Prompt-Restore-Prompt” pipeline that adeptly harnesses weather-specific knowledge, textual contexts, and reliable textures. Extensive experiments on synthetic and real-world datasets validate the superior performance of CyclicPrompt. The code is available at: https://github.com/RongxinL/CyclicPrompt.Keywords
All Related Versions
Funding Information
- Beijing Natural Science Foundation (L223022)
- National Natural Science Foundation of China (62331003, 62302141, 62472138, U24A20331)
- Natural Science Foundation of Anhui Province (2408085MF159)
This publication has 96 references indexed in Scilit:
- InstructIR: High-Quality Image Restoration Following Human Instructions2024
- Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraint2024
- Simple Baselines for Image Restoration2022
- TAPE: Task-Agnostic Prior Embedding for Image Restoration2022
- Visual Prompt Tuning2022
- Master of All: Simultaneous Generalization of Urban-Scene Segmentation to All Adverse Weather Conditions2022
- Learning to Prompt for Vision-Language ModelsInternational Journal of Computer Vision, 2022
- JSTASR: Joint Size and Transparency-Aware Snow Removal Algorithm Based on Modified Partial Convolution and Veiling Effect Removal2020
- Robust Optical Flow in Rainy Scenes2018
- Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining2018