Synthesizing Realistic Image Restoration Training Pairs: A Diffusion Approach
Preprint
Abstract
In supervised image restoration tasks, one key issue is how to obtain the aligned high-quality (HQ) and low-quality (LQ) training image pairs. Unfortunately, such HQ-LQ training pairs are hard to capture in practice, and hard to synthesize due to the complex unknown degradation in the wild. While several sophisticated degradation models have been manually designed to synthesize LQ images from their HQ counterparts, the distribution gap between the synthesized and real-world LQ images remains large. We propose a new approach to synthesizing realistic image restoration training pairs using the emerging denoising diffusion probabilistic model (DDPM). First, we train a DDPM, which could convert a noisy input into the desired LQ image, with a large amount of collected LQ images, which define the target data distribution. Then, for a given HQ image, we synthesize an initial LQ image by using an off-the-shelf degradation model, and iteratively add proper Gaussian noises to it. Finally, we denoise the noisy LQ image using the pre-trained DDPM to obtain the final LQ image, which falls into the target distribution of real-world LQ images. Thanks to the strong capability of DDPM in distribution approximation, the synthesized HQ-LQ image pairs can be used to train robust models for real-world image restoration tasks, such as blind face image restoration and blind image super-resolution. Experiments demonstrated the superiority of our proposed approach to existing degradation models. Code and data will be released.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolution2022
- Component Divide-and-Conquer for Real-World Image Super-Resolution2020
- Blind Face Restoration via Deep Multi-scale Component Dictionaries2020
- Face Super-Resolution Guided by 3D Facial Priors2020
- ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks2019
- Learning Warped Guidance for Blind Face Restoration2018
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network2017
- Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution2017
- Deep Residual Learning for Image Recognition2016