TCGAN: a transformer-enhanced GAN for PET synthetic CT
- 24 October 2022
- journal article
- research article
- Published by Optica Publishing Group in Biomedical Optics Express
- Vol. 13 (11) , 6003-6018
Abstract
Multimodal medical images can be used in a multifaceted approach to resolve a wide range of medical diagnostic problems. However, these images are generally difficult to obtain due to various limitations, such as cost of capture and patient safety. Medical image synthesis is used in various tasks to obtain better results. Recently, various studies have attempted to use generative adversarial networks for missing modality image synthesis, making good progress. In this study, we propose a generator based on a combination of transformer network and a convolutional neural network (CNN). The proposed method can combine the advantages of transformers and CNNs to promote a better detail effect. The network is designed for positron emission tomography (PET) to computer tomography synthesis, which can be used for PET attenuation correction. We also experimented on two datasets for magnetic resonance T1- to T2-weighted image synthesis. Based on qualitative and quantitative analyses, our proposed method outperforms the existing methods.Keywords
Funding Information
- Major Scientific and Technological Innovation Project of Shandong Province (2019JZZY021003)
- National Natural Science Foundation of China (61771230)
This publication has 22 references indexed in Scilit:
- Ea-GANs: Edge-Aware Generative Adversarial Networks for Cross-Modality MR Image SynthesisIEEE Transactions on Medical Imaging, 2019
- Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial NetworksIEEE Transactions on Medical Imaging, 2019
- GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classificationNeurocomputing, 2018
- SynSeg-Net: Synthetic Segmentation Without Target Modality Ground TruthIEEE Transactions on Medical Imaging, 2018
- Medical Image Synthesis with Deep Convolutional Adversarial NetworksIEEE Transactions on Biomedical Engineering, 2018
- Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic featuresScientific Data, 2017
- Medical Image Synthesis with Context-Aware Generative Adversarial Networks2017
- The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)IEEE Transactions on Medical Imaging, 2015
- MR to CT registration of brains using image synthesis2014
- Image information and visual qualityIEEE Transactions on Image Processing, 2006