Pre-treatment multimodal artificial intelligence for prognostic stratification in locally advanced rectal cancer
Preprint
- 9 September 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
Accurate prognostic assessment before neoadjuvant chemoradiotherapy remains challenging for locally advanced rectal cancer (LARC), limiting personalised treatment decisions. Here, we develop the Integrated Multimodal Prognostic Assessment for Locally Advanced Rectal Cancer Neoadjuvant Chemoradiotherapy (IMPACT), an artificial intelligence framework employing bidirectional multimodal attention mechanisms to capture cross-modal feature interactions and integrating pre-treatment pelvic magnetic resonance imaging, pathological biopsy whole slide images, and clinical information from 752 LARC patients across two independent centres. IMPACT achieves C-indexes of 0.805 for overall survival and 0.760 for disease-free survival, significantly outperforming the Guideline-based Imaging Risk Score (0.712 and 0.697, respectively). High-risk patients demonstrate 8.3-fold increased mortality risk and 6.5-fold increased recurrence risk compared to low-risk patients. External validation maintains robust performance with preserved risk stratification capability. Systematic ablation studies confirm the incremental value of trimodal fusion over single-modality approaches. IMPACT enables accurate pre-treatment prognostic stratification, facilitating evidence-based treatment intensification for high-risk patients and de-escalation strategies for low-risk cases in clinical practice.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Enhanced risk stratification for stage II colorectal cancer using deep learning-based CT classifier and pathological markers to optimize adjuvant therapy decisionAnnals of Oncology, 2025
- A novel multimodal deep learning model for preoperative prediction of microvascular invasion and outcome in hepatocellular carcinomaEuropean Journal of Surgical Oncology, 2022
- Development and validation of a weakly supervised deep learning framework to predict the status of molecular pathways and key mutations in colorectal cancer from routine histology images: a retrospective studyThe Lancet Digital Health, 2021
- Deep learning‐assisted magnetic resonance imaging prediction of tumor response to chemotherapy in patients with colorectal liver metastasesInternational Journal of Cancer, 2020
- Localised colon cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-upAnnals of Oncology, 2020
- Artificial intelligence in medical imaging: switching from radiographic pathological data to clinically meaningful endpointsThe Lancet Digital Health, 2020
- Deep learning for prediction of colorectal cancer outcome: a discovery and validation studyThe Lancet, 2020
- Colorectal cancerThe Lancet, 2019
- World Medical Association Declaration of HelsinkiJAMA, 2013
- Preoperative chemoradiotherapy and postoperative chemotherapy with fluorouracil and oxaliplatin versus fluorouracil alone in locally advanced rectal cancer: initial results of the German CAO/ARO/AIO-04 randomised phase 3 trialThe Lancet Oncology, 2012