Multimodal deep learning models for the prediction of pathologic response to neoadjuvant chemotherapy in breast cancer
Authors:
- Myung Jin ChungMCMyung Jin Chung
- Young-Hyuck ImYIYoung-Hyuck Im
Top Cited Papers
Open Access
- 22 September 2021
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 11 (1) , 1-8
Abstract
The achievement of the pathologic complete response (pCR) has been considered a metric for the success of neoadjuvant chemotherapy (NAC) and a powerful surrogate indicator of the risk of recurrence and long-term survival. This study aimed to develop a multimodal deep learning model that combined clinical information and pretreatment MR images for predicting pCR to NAC in patients with breast cancer. The retrospective study cohort consisted of 536 patients with invasive breast cancer who underwent pre-operative NAC. We developed a deep learning model to fuse high-dimensional MR image features and the clinical information for the pretreatment prediction of pCR to NAC in breast cancer. The proposed deep learning model trained on all datasets as clinical information, T1-weighted subtraction images, and T2-weighted images shows better performance with area under the curve (AUC) of 0.888 as compared to the model using only clinical information (AUC = 0.827, P < 0.05). Our results demonstrate that the multimodal fusion approach using deep learning with both clinical information and MR images achieve higher prediction performance compared to the deep learning model without the fusion approach. Deep learning could integrate pretreatment MR images with clinical information to improve pCR prediction performance.Keywords
This publication has 38 references indexed in Scilit:
- Computer-aided detection in breast MRI: a systematic review and meta-analysisEuropean Radiology, 2011
- Non-local MRI upsamplingMedical Image Analysis, 2010
- Diffusion-weighted MR Imaging: Pretreatment Prediction of Response to Neoadjuvant Chemotherapy in Patients with Breast CancerRadiology, 2010
- Predictive markers of response to neoadjuvant chemotherapy in breast cancerSurgical Oncology, 2008
- Preoperative Chemotherapy: Updates of National Surgical Adjuvant Breast and Bowel Project Protocols B-18 and B-27Journal of Clinical Oncology, 2008
- Recommendations From an International Expert Panel on the Use of Neoadjuvant (Primary) Systemic Treatment of Operable Breast Cancer: An UpdateJournal of Clinical Oncology, 2006
- Clinical and Pathological Predictors of the Response to Neoadjuvant Anthracycline Chemotherapy in Locally Advanced Breast CancerMedical Oncology, 2006
- Nomograms to Predict Pathologic Complete Response and Metastasis-Free Survival After Preoperative Chemotherapy for Breast CancerJournal of Clinical Oncology, 2005
- New variants of a method of MRI scale standardizationIEEE Transactions on Medical Imaging, 2000
- A method of comparing the areas under receiver operating characteristic curves derived from the same cases.Radiology, 1983