Restoring Fluorescence Microscopy Images by Transfer Learning From Tailored Data
Open Access
- 9 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 61016-61033
Abstract
In fluorescence microscopy imaging, noise is a very usual phenomenon. To some extent, it can be suppressed by increasing the amount of the photon exposure; however, it is not preferable since this may not be tolerated by the subjected specimen. Thus, a sophisticated computational method is needed to denoise each acquired micrograph, so that they become more adequate for further feature extraction and image analysis. However, apart from the difficulties of the denoising problem itself, one main challenge is that the absence of the ground-truth images makes the data-driven techniques less applicable. In order to tackle this challenge, we suggest to tailor a dataset by handpicking images from unrelated source datasets. Our tailoring strategy involves exploring some low-level view-based features of the candidate images, and their similarities to those of the fluorescence microscopy images. We pretrain and fine-tune the wellknown feed-forward denoising convolutional neural networks (DnCNNs) on our tailored dataset and a very limited amount of fluorescence images, respectively to ensure both the diversity and the content-awareness. The quantitative and visual experimentation show that our approach is able to curate a dataset, which is significantly superior to the arbitrarily chosen source images, and well-approximates to the fluorescence images. Moreover, the combination of the tailored dataset with a few fluorescence data through the use of fine-tuning offers a good balance between the generalization capability and the content-awareness, on the majority of considered scenarios.Keywords
This publication has 74 references indexed in Scilit:
- Distributional Learning of AppearancePLOS ONE, 2013
- Sparse regularization in limited angle tomographyApplied and Computational Harmonic Analysis, 2013
- Annotated high-throughput microscopy image sets for validationNature Methods, 2012
- Fast interscale wavelet denoising of Poisson-corrupted imagesSignal Processing, 2010
- Nonlocal Operators with Applications to Image ProcessingMultiscale Modeling & Simulation, 2009
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse RepresentationIEEE Transactions on Signal Processing, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- The curvelet transform for image denoisingIEEE Transactions on Image Processing, 2002
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992
- The Transformation of Poisson, Binomial and Negative-Binomial DataBiometrika, 1948