Deblurring via Stochastic Refinement
Authors:
Top Cited Papers
- 1 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 16272-16282
Abstract
Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These metrics are known to be poorly correlated with human perception, and often lead to unrealistic reconstructions. We present an alternative framework for blind deblurring based on conditional diffusion models. Unlike existing techniques, we train a stochastic sampler that refines the output of a deterministic predictor and is capable of producing a diverse set of plausible reconstructions for a given input. This leads to a significant improvement in perceptual quality over existing state-of-the-art methods across multiple standard benchmarks. Our predict-and-refine approach also enables much more efficient sampling compared to typical diffusion models. Combined with a carefully tuned network architecture and inference procedure, our method is competitive in terms of distortion metrics such as PSNR. These results show clear benefits of our diffusion-based method for deblurring and challenge the widely used strategy of producing a single, deterministic reconstruction.Keywords
All Related Versions
This publication has 42 references indexed in Scilit:
- NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study2017
- Deep Video Deblurring for Hand-Held Cameras2017
- Image Style Transfer Using Convolutional Neural Networks2016
- A Comparative Study for Single Image Blind Deblurring2016
- Learning a convolutional neural network for non-uniform motion blur removal2015
- Deconvolving PSFs for a Better Motion Deblurring Using Multiple Images2012
- High-quality motion deblurring from a single imageACM Transactions on Graphics, 2008
- Removing camera shake from a single photograph2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Total variation blind deconvolutionIEEE Transactions on Image Processing, 1998