A Novel Multi-Modal Population-Graph Based Framework for Patients of Esophageal Squamous Cell Cancer Prognostic Risk Prediction
- 6 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (5) , 3206-3219
Abstract
Prognostic risk prediction is pivotal for clinicians to appraise the patient's esophageal squamous cell cancer (ESCC) progression status precisely and tailor individualized therapy treatment plans. Currently, CT-based multi-modal prognostic risk prediction methods have gradually attracted the attention of researchers for their universality, which is also able to be applied in scenarios of preoperative prognostic risk assessment in the early stages of cancer. However, much of the current work focuses only on CT images of the primary tumor, ignoring the important role that CT images of lymph nodes play in prognostic risk prediction. Additionally, it is important to consider and explore the inter-patient feature similarity in prognosis when developing models. To solve these problems, we proposed a novel multi-modal population-graph based framework leveraging CT images including primary tumor and lymph nodes combined with clinical, hematology, and radiomics data for ESCC prognostic risk prediction. A patient population graph was constructed to excavate the homogeneity and heterogeneity of inter-patient feature embedding. Moreover, a novel node-level multi-task joint loss was proposed for graph model optimization through a supervised-based task and an unsupervised-based task. Sufficient experimental results show that our model achieved state-of-the-art performance compared with other baseline models as well as the gold standard on discriminative ability, risk stratification, and clinical utility. The core code is available at https://github.com/wuchengyu123/MPGSurv .Keywords
Funding Information
- National Natural Science Foundation of China (62201323, 62206242, 82072014, 62076149, 62376136)
- Natural Science Foundation of Jiangsu Province (BK20220266)
- National Fund Joint Fund for Regional Innovation and Development (U20A20386)
- Science and Technology Department of Sichuan Province (2023YFS0488, 2023YFQ0055)
This publication has 56 references indexed in Scilit:
- Development and Validation of Esophageal Squamous Cell Carcinoma Risk Prediction Models Based on an Endoscopic Screening ProgramJAMA Network Open, 2023
- A Gallbladder Cancer Survival Prediction Model Based on Multimodal Fusion AnalysisDigestive Diseases and Sciences, 2022
- TMSS: An End-to-End Transformer-Based Multimodal Network for Segmentation and Survival Prediction2022
- Progression Free Survival Prediction for Head and Neck Cancer Using Deep Learning Based on Clinical and PET/CT Imaging Data2022
- Risk Prediction Model of 90-Day Mortality After Esophagectomy for CancerJAMA Surgery, 2021
- Modified MobileNet for Patient Survival Prediction2021
- Integrative nomogram of CT imaging, clinical, and hematological features for survival prediction of patients with locally advanced non-small cell lung cancerEuropean Radiology, 2019
- ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design2018
- Esophageal cancer lymph node metastasis–associated gene signature optimizes overall survival prediction of esophageal cancerJournal of Cellular Biochemistry, 2018
- Fast Training of Support Vector Machines for Survival Analysis2015