Deep learning for whole-body medical image generation
- 22 May 2021
- journal article
- research article
- Published by Springer Nature in European Journal of Nuclear Medicine and Molecular Imaging
- Vol. 48 (12) , 3817-3826
Abstract
Background Artificial intelligence (AI) algorithms based on deep convolutional networks have demonstrated remarkable success for image transformation tasks. State-of-the-art results have been achieved by generative adversarial networks (GANs) and training approaches which do not require paired data. Recently, these techniques have been applied in the medical field for cross-domain image translation. Purpose This study investigated deep learning transformation in medical imaging. It was motivated to identify generalizable methods which would satisfy the simultaneous requirements of quality and anatomical accuracy across the entire human body. Specifically, whole-body MR patient data acquired on a PET/MR system were used to generate synthetic CT image volumes. The capacity of these synthetic CT data for use in PET attenuation correction (AC) was evaluated and compared to current MR-based attenuation correction (MR-AC) methods, which typically use multiphase Dixon sequences to segment various tissue types. Materials and methods This work aimed to investigate the technical performance of a GAN system for general MR-to-CT volumetric transformation and to evaluate the performance of the generated images for PET AC. A dataset comprising matched, same-day PET/MR and PET/CT patient scans was used for validation. Results A combination of training techniques was used to produce synthetic images which were of high-quality and anatomically accurate. Higher correlation was found between the values of mu maps calculated directly from CT data and those derived from the synthetic CT images than those from the default segmented Dixon approach. Over the entire body, the total amounts of reconstructed PET activities were similar between the two MR-AC methods, but the synthetic CT method yielded higher accuracy for quantifying the tracer uptake in specific regions. Conclusion The findings reported here demonstrate the feasibility of this technique and its potential to improve certain aspects of attenuation correction for PET/MR systems. Moreover, this work may have larger implications for establishing generalized methods for inter-modality, whole-body transformation in medical imaging. Unsupervised deep learning techniques can produce high-quality synthetic images, but additional constraints may be needed to maintain medical integrity in the generated data. Graphical abstractKeywords
This publication has 16 references indexed in Scilit:
- Independent attenuation correction of whole body [18F]FDG-PET using a deep learning approach with Generative Adversarial NetworksEJNMMI Research, 2020
- Deep learning-based attenuation correction in the absence of structural information for whole-body positron emission tomography imagingPhysics in Medicine & Biology, 2020
- Generative adversarial network in medical imaging: A reviewMedical Image Analysis, 2019
- Unsupervised Medical Image Translation Using Cycle-MedGAN2019
- Unpaired whole-body MR to CT synthesis with correlation coefficient constrained adversarial learning2019
- Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial NetworksIEEE Transactions on Medical Imaging, 2019
- Generation of PET Attenuation Map for Whole-Body Time-of-Flight18F-FDG PET/MRI Using a Deep Neural Network Trained with Simultaneously Reconstructed Activity and Attenuation MapsJournal of Nuclear Medicine, 2019
- Zero-Echo-Time and Dixon Deep Pseudo-CT (ZeDD CT): Direct Generation of Pseudo-CT Images for Pelvic PET/MRI Attenuation Correction Using Deep Convolutional Neural Networks with Multiparametric MRIJournal of Nuclear Medicine, 2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- Deep MR to CT Synthesis Using Unpaired Data2017