Unsupervised knowledge-transfer for learned image reconstruction*
Open Access
- 8 September 2022
- journal article
- research article
- Published by IOP Publishing in Inverse Problems
- Vol. 38 (10) , 104004
Abstract
Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only.Keywords
All Related Versions
Funding Information
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (EP/S021930/1)
- Engineering and Physical Sciences Research Council (EP/N510129/1)
This publication has 27 references indexed in Scilit:
- Deep learning with domain adaptation for accelerated projection‐reconstruction MRMagnetic Resonance in Medicine, 2018
- Learned Primal-Dual ReconstructionIEEE Transactions on Medical Imaging, 2018
- Solving ill-posed inverse problems using iterative deep neural networksInverse Problems, 2017
- Deep Convolutional Neural Network for Inverse Problems in ImagingIEEE Transactions on Image Processing, 2017
- Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural NetworkIEEE Transactions on Medical Imaging, 2017
- The ASTRA Toolbox: A platform for advanced algorithm development in electron tomographyUltramicroscopy, 2015
- Noise reduction for low-dose single-slice helical CT sinogramsIEEE Transactions on Nuclear Science, 2006
- Nonlinear sinogram smoothing for low-dose X-ray CTIEEE Transactions on Nuclear Science, 2004
- Lung Image Database Consortium: Developing a Resource for the Medical Imaging Research CommunityRadiology, 2004
- An Introduction to Variational Methods for Graphical ModelsMachine Learning, 1999