Comparison of Supervised and Unsupervised Deep Learning Methods for Medical Image Synthesis between Computed Tomography and Magnetic Resonance Images
Open Access
- 1 January 2020
- journal article
- research article
- Published by Wiley in BioMed Research International
- Vol. 2020 (1) , 5193707
Abstract
Cross‐modality medical image synthesis between magnetic resonance (MR) images and computed tomography (CT) images has attracted increasing attention in many medical imaging area. Many deep learning methods have been used to generate pseudo‐MR/CT images from counterpart modality images. In this study, we used U‐Net and Cycle‐Consistent Adversarial Networks (CycleGAN), which were typical networks of supervised and unsupervised deep learning methods, respectively, to transform MR/CT images to their counterpart modality. Experimental results show that synthetic images predicted by the proposed U‐Net method got lower mean absolute error (MAE), higher structural similarity index (SSIM), and peak signal‐to‐noise ratio (PSNR) in both directions of CT/MR synthesis, especially in synthetic CT image generation. Though synthetic images by the U‐Net method has less contrast information than those by the CycleGAN method, the pixel value profile tendency of the synthetic images by the U‐Net method is closer to the ground truth images. This work demonstrated that supervised deep learning method outperforms unsupervised deep learning method in accuracy for medical tasks of MR/CT synthesis.Keywords
Funding Information
- National Natural Science Foundation of China (61871374)
- Beijing Center for Mathematics and Information Interdisciplinary Sciences
- Natural Science Foundation of Guangdong Province (2014A030312006, 2015B020233011, 2017B020229002)
This publication has 32 references indexed in Scilit:
- Prediction of CT Substitutes from MR Images Based on Local Diffeomorphic Mapping for Brain PET Attenuation CorrectionJournal of Nuclear Medicine, 2016
- Vision 20/20: Magnetic resonance imaging‐guided attenuation correction in PET/MRI: Challenges, solutions, and opportunitiesMedical Physics, 2016
- Automatic Substitute Computed Tomography Generation and Contouring for Magnetic Resonance Imaging (MRI)-Alone External Beam Radiation Therapy From Standard MRI SequencesInternational Journal of Radiation Oncology - Biology - Physics (IJROBP), 2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Radiotherapy planning using MRIPhysics in Medicine & Biology, 2015
- Attenuation Correction Synthesis for Hybrid PET-MR Scanners: Application to Brain StudiesIEEE Transactions on Medical Imaging, 2014
- The Value of Magnetic Resonance Imaging for Radiotherapy PlanningSeminars in Radiation Oncology, 2014
- elastix: A Toolbox for Intensity-Based Medical Image RegistrationIEEE Transactions on Medical Imaging, 2009
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A Threshold Selection Method from Gray-Level HistogramsIEEE Transactions on Systems, Man, and Cybernetics, 1979