One-Pot Multi-Frame Denoising
Preprint
Abstract
The performance of learning-based denoising largely depends on clean supervision. However, it is difficult to obtain clean images in many scenes. On the contrary, the capture of multiple noisy frames for the same field of view is available and often natural in real life. Therefore, it is necessary to avoid the restriction of clean labels and make full use of noisy data for model training. So we propose an unsupervised learning strategy named one-pot denoising (OPD) for multi-frame images. OPD is the first proposed unsupervised multi-frame denoising (MFD) method. Different from the traditional supervision schemes including both supervised Noise2Clean (N2C) and unsupervised Noise2Noise (N2N), OPD executes mutual supervision among all of the multiple frames, which gives learning more diversity of supervision and allows models to mine deeper into the correlation among frames. N2N has also been proved to be actually a simplified case of the proposed OPD. From the perspectives of data allocation and loss function, two specific implementations, random coupling (RC) and alienation loss (AL), are respectively provided to accomplish OPD during model training. In practice, our experiments demonstrate that OPD behaves as the SOTA unsupervised denoising method and is comparable to supervised N2C methods for synthetic Gaussian and Poisson noise, and real-world optical coherence tomography (OCT) speckle noise.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- SAR2SAR: A Semi-Supervised Despeckling Algorithm for SAR ImagesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021
- Denoising PET images for proton therapy using a residual U-netBiomedical Physics & Engineering Express, 2021
- N2NSR‐OCT: Simultaneous denoising and super‐resolution in optical coherence tomography images using semisupervised deep learningJournal of Biophotonics, 2020
- Hyperspectral and Multispectral Image Fusion Under Spectrally Varying Spatial Blurs – Application to High Dimensional Infrared Astronomical ImagingIEEE Transactions on Computational Imaging, 2020
- Attention-guided CNN for image denoisingNeural Networks, 2020
- MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentationNeural Networks, 2020
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image DenoisingIEEE Transactions on Image Processing, 2017
- Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal TransformsIEEE Transactions on Image Processing, 2012
- Image Denoising by Sparse 3-D Transform-Domain Collaborative FilteringIEEE Transactions on Image Processing, 2007
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004