Real-world data to build explainable trustworthy artificial intelligence models for prediction of immunotherapy efficacy in NSCLC patients
Authors:
Open Access
- 23 January 2023
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Oncology
- Vol. 12, 1078822
Abstract
Introduction: Artificial Intelligence (AI) methods are being increasingly investigated as a means to generate predictive models applicable in the clinical practice. In this study, we developed a model to predict the efficacy of immunotherapy (IO) in patients with advanced non-small cell lung cancer (NSCLC) using eXplainable AI (XAI) Machine Learning (ML) methods.Methods: We prospectively collected real-world data from patients with an advanced NSCLC condition receiving immune-checkpoint inhibitors (ICIs) either as a single agent or in combination with chemotherapy. With regards to six different outcomes - Disease Control Rate (DCR), Objective Response Rate (ORR), 6 and 24-month Overall Survival (OS6 and OS24), 3-months Progression-Free Survival (PFS3) and Time to Treatment Failure (TTF3) - we evaluated five different classification ML models: CatBoost (CB), Logistic Regression (LR), Neural Network (NN), Random Forest (RF) and Support Vector Machine (SVM). We used the Shapley Additive Explanation (SHAP) values to explain model predictions.Results: Of 480 patients included in the study 407 received immunotherapy and 73 chemo- and immunotherapy. From all the ML models, CB performed the best for OS6 and TTF3, (accuracy 0.83 and 0.81, respectively). CB and LR reached accuracy of 0.75 and 0.73 for the outcome DCR. SHAP for CB demonstrated that the feature that strongly influences models’ prediction for all three outcomes was Neutrophil to Lymphocyte Ratio (NLR). Performance Status (ECOG-PS) was an important feature for the outcomes OS6 and TTF3, while PD-L1, Line of IO and chemo-immunotherapy appeared to be more important in predicting DCR.Conclusions: In this study we developed a ML algorithm based on real-world data, explained by SHAP techniques, and able to accurately predict the efficacy of immunotherapy in sets of NSCLC patients.Keywords
This publication has 34 references indexed in Scilit:
- Correction to: “Metastatic non-small cell lung cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up”Annals of Oncology, 2019
- Predictive biomarkers of response for immune checkpoint inhibitors in non–small-cell lung cancerEuropean Journal of Cancer, 2019
- PASNet: pathway-associated sparse deep neural network for prognosis prediction from high-throughput dataBMC Bioinformatics, 2018
- Hyperprogressive Disease in Patients With Advanced Non–Small Cell Lung Cancer Treated With PD-1/PD-L1 Inhibitors or With Single-Agent ChemotherapyJAMA Oncology, 2018
- Explainable machine-learning predictions for the prevention of hypoxaemia during surgeryNature Biomedical Engineering, 2018
- Multiple Instance Learning for Heterogeneous Images: Training a CNN for Histopathology2018
- Association of the Lung Immune Prognostic Index With Immune Checkpoint Inhibitor Outcomes in Patients With Advanced Non–Small Cell Lung CancerJAMA Oncology, 2018
- FDA Approval Summary: Pembrolizumab for Treatment of Metastatic Non-Small Cell Lung Cancer: First-Line Therapy and BeyondThe Oncologist, 2017
- Object-oriented regression for building predictive models with high dimensional omics data from translational studiesJournal of Biomedical Informatics, 2016
- Manifold Learning in MR spectroscopy using nonlinear dimensionality reduction and unsupervised clusteringMagnetic Resonance in Medicine, 2014