Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translation
Authors:
- Minh-Son ToMTMinh-Son To
Preprint
Abstract
Medical image synthesis is a challenging task due to the scarcity of paired data. Several methods have applied CycleGAN to leverage unpaired data, but they often generate inaccurate mappings that shift the anatomy. This problem is further exacerbated when the images from the source and target modalities are heavily misaligned. Recently, current methods have aimed to address this issue by incorporating a supplementary segmentation network. Unfortunately, this strategy requires costly and time-consuming pixel-level annotations. To overcome this problem, this paper proposes MaskGAN, a novel and cost-effective framework that enforces structural consistency by utilizing automatically extracted coarse masks. Our approach employs a mask generator to outline anatomical structures and a content generator to synthesize CT contents that align with these structures. Extensive experiments demonstrate that MaskGAN outperforms state-of-the-art synthesis methods on a challenging pediatric dataset, where MR and CT scans are heavily misaligned due to rapid growth in children. Specifically, MaskGAN excels in preserving anatomical structures without the need for expert annotations. The code for this paper can be found at https://github.com/HieuPhan33/MaskGAN.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Mapping in Cycles: Dual-Domain PET-CT Synthesis Framework with Cycle-Consistent Constraints2022
- Unsupervised-learning-based method for chest MRI–CT transformation using structure constrained unsupervised generative attention networksScientific Reports, 2022
- SA-GAN: Structure-Aware GAN for Organ-Preserving Synthetic CT Generation2021
- CT synthesis from MRI using multi-cycle GAN for head-and-neck radiation therapyComputerized Medical Imaging and Graphics, 2021
- Anatomy-guided multimodal registration by learning segmentation without ground truth: Application to intraprocedural CBCT/MR liver segmentation and registrationMedical Image Analysis, 2021
- MedGAN: Medical image translation using GANsComputerized Medical Imaging and Graphics, 2020
- Unpaired Brain MR-to-CT Synthesis Using a Structure-Constrained CycleGAN2018
- Deep MR to CT Synthesis Using Unpaired Data2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Surgical correction of craniosynostosis. A review of 100 casesJournal of Cranio-Maxillofacial Surgery, 2014