Machine Learning and Real-World Data to Predict Lung Cancer Risk in Routine Care
Open Access
- 28 December 2022
- journal article
- research article
- Published by American Association for Cancer Research (AACR) in Cancer Epidemiology, Biomarkers & Prevention
- Vol. 32 (3) , 337-343
Abstract
Background: This study used machine learning to develop a 3-year lung cancer risk prediction model with large real-world data in a mostly younger population. Methods: Over 4.7 million individuals, aged 45 to 65 years with no history of any cancer or lung cancer screening, diagnostic, or treatment procedures, with an outpatient visit in 2013 were identified in Optum's de-identified Electronic Health Record (EHR) dataset. A least absolute shrinkage and selection operator model was fit using all available data in the 365 days prior. Temporal validation was assessed with recent data. External validation was assessed with data from Mercy Health Systems EHR and Optum's de-identified Clinformatics Data Mart Database. Racial inequities in model discrimination were assessed with xAUCs. Results: The model AUC was 0.76. Top predictors included age, smoking, race, ethnicity, and diagnosis of chronic obstructive pulmonary disease. The model identified a high-risk group with lung cancer incidence 9 times the average cohort incidence, representing 10% of patients with lung cancer. Model performed well temporally and externally, while performance was reduced for Asians and Hispanics. Conclusions: A high-dimensional model trained using big data identified a subset of patients with high lung cancer risk. The model demonstrated transportability to EHR and claims data, while underscoring the need to assess racial disparities when using machine learning methods. Impact: This internally and externally validated real-world data-based lung cancer prediction model is available on an open-source platform for broad sharing and application. Model integration into an EHR system could minimize physician burden by automating identification of high-risk patients.Keywords
All Related Versions
Funding Information
- Perelman School of Medicine, University of Pennsylvania (NA)
- Vanderbilt University
This publication has 20 references indexed in Scilit:
- A Comparative Modeling Analysis of Risk-Based Lung Cancer Screening StrategiesJNCI: Journal of the National Cancer Institute, 2019
- Prediction of the 1-Year Risk of Incident Lung Cancer: Prospective Study Using Electronic Health Records from the State of MaineJournal of Medical Internet Research, 2019
- Design and implementation of a standardized framework to generate and evaluate patient-level prediction models using observational healthcare dataJournal of the American Medical Informatics Association, 2018
- Validation of a Case-Finding Algorithm for Identifying Patients with Non-small Cell Lung Cancer (NSCLC) in Administrative Claims DatabasesFrontiers in Pharmacology, 2017
- Classifying Lung Cancer Severity with Ensemble Machine Learning in Health Care Claims Data.2017
- Identifying incident colorectal and lung cancer cases in health service utilisation databases in Australia: a validation studyBMC Medical Informatics and Decision Making, 2017
- The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced DatasetsPLOS ONE, 2015
- Trends in the Proportion of Patients With Lung Cancer Meeting Screening CriteriaJAMA, 2015
- Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD StatementBMC Medicine, 2015
- Agreement of diagnosis and its date for hematologic malignancies and solid tumors between medicare claims and cancer registry dataCancer Causes & Control, 2007