Unsupervised Image Restoration Using Partially Linear Denoisers
Authors:
- 5 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 44 (01628828) , 1
Abstract
Deep neural network based methods are the state of the art in various image restoration problems. Standard supervised learning frameworks require a set of noisy measurement and clean image pairs for which a distance between the output of the restoration model and the ground truth, clean images is minimized. The ground truth images, however, are often unavailable or very expensive to acquire in real-world applications. We circumvent this problem by proposing a class of structured denoisers that can be decomposed as the sum of a nonlinear image-dependent mapping, a linear noise-dependent term and a small residual term. We show that these denoisers can be trained with only noisy images under the condition that the noise has zero mean and known variance. The exact distribution of the noise, however, is not assumed to be known. We show the superiority of our approach for image denoising, and demonstrate its extension to solving other restoration problems such as image deblurring where the ground truth is not available. Our method outperforms some recent unsupervised and self-supervised deep denoising models that do not require clean images for their training. For deblurring problems, the method, using only one noisy and blurry observation per image, reaches a quality not far away from its fully supervised counterparts on a benchmark dataset.Keywords
All Related Versions
Funding Information
- Wellcome Innovator Award (RG98755)
- Leverhulme Trust (Breaking the non-convexity barrier)
- Engineering and Physical Sciences Research Council (EP/N014588/1, EP/S026045/1, EP/T003553/1)
This publication has 35 references indexed in Scilit:
- Practical Signal-Dependent Noise Parameter Estimation From a Single Noisy ImageIEEE Transactions on Image Processing, 2014
- Unnatural L0 Sparse Representation for Natural Image Deblurring2013
- Interactive Facial Feature Localization2012
- Noise Estimation from a Single Image2006
- Fields of Experts: A Framework for Learning Image Priors2005
- A Non-Local Algorithm for Image Denoising2005
- A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics2002
- De-noising by soft-thresholdingIEEE Transactions on Information Theory, 1995
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992
- Singularity detection and processing with waveletsIEEE Transactions on Information Theory, 1992