Enhanced Risk Stratification of Gastrointestinal Stromal Tumors Through Cross-Modality Synthesis from CT to [¹⁸F]-FDG PET Images
- 11 December 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Radiation and Plasma Medical Sciences
- Vol. 9 (4) , 487-496
Abstract
Risk stratification algorithms for gastrointestinal stromal tumors (GISTs) are mainly based on Computed Tomography (CT) data. Though 18F-Fluorodeoxyglucose Positron Emission Tomography (18F-FDG PET) imaging may improve their performance, challenges in image interpretation in the gastrointestinal tract still limit the widespread integration of PET into routine clinical protocols, causing a poor availability of PET data to develop and train stratification models. To solve this issue, we propose to enrich existing 18F-FDG PET GIST datasets with pseudo-images generated with a novel Conditional PET Generative Adversarial Network (CPGAN), which employs a weighted fusion of CT images and tumor masks, embedding also clinical data. As for GIST assessment, we propose the Transformer-Based Multi-Modal Network for GIST Risk Stratification (TMGRS), which is trained on the enriched dataset and exploits the properties of transformers to process simultaneously PET and CT images. The training and validation of the models were conducted on a multi-center dataset comprising 208 patients. In comparison with the existing stratification methods, CPGAN-synthesized PET images show a Peak Signal-to-Noise Ratio increased on average by 18% and improve risk stratification, which achieves a remarkable accuracy of 0.937 when TMGRS network is used. Results underscore the potential of CPGAN network in providing more reliable GIST predictions.Keywords
Funding Information
- University Synergy Innovation Program of Anhui Province (GXXT-2022-032)
- Start-Up Fund of USTC “Research on Total Solid Angle PET-EPR Multimodal Intelligent Imaging.”
This publication has 31 references indexed in Scilit:
- Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translation2023
- An interpretable AI model for recurrence prediction after surgery in gastrointestinal stromal tumour: an observational cohort studyeClinicalMedicine, 2023
- RETRACTED ARTICLE: A hybrid feature pyramid network and Efficient Net-B0-based GIST detection and segmentation from fused CT-PET imageSoft Computing, 2023
- Risk stratification for 1- to 2-cm gastric gastrointestinal stromal tumors: visual assessment of CT and EUS high-risk features versus CT radiomics analysisEuropean Radiology, 2022
- Mapping in Cycles: Dual-Domain PET-CT Synthesis Framework with Cycle-Consistent Constraints2022
- An Ensemble Approach for Patient Prognosis of Head and Neck Tumor Using Multimodal Data2022
- Conditional GAN with an Attention-Based Generator and a 3D Discriminator for 3D Medical Image Generation2021
- Cross-modality synthesis from CT to PET using FCN and GAN networks for improved automated lesion detectionEngineering Applications of Artificial Intelligence, 2019
- Adversarial Image Synthesis for Unpaired Multi-modal Cardiac Data2017
- Optimal classification treesMachine Learning, 2017