Development and Portability of a Text Mining Algorithm for Capturing Disease Progression in Electronic Health Records of Patients With Stage IV Non–Small Cell Lung Cancer
Open Access
- 1 October 2024
- journal article
- research article
- Published by American Society of Clinical Oncology (ASCO) in JCO Clinical Cancer Informatics
- Vol. 8 (8) , e2400053
Abstract
PURPOSE: The objective was to develop and evaluate the portability of a text mining algorithm for prospectively capturing disease progression in electronic health record (EHR) data of patients with metastatic non–small cell lung cancer (mNSCLC) treated with immunochemotherapy. METHODS: This study used EHR data from patients with mNSCLC receiving immunochemotherapy (between October 1, 2018, and December 31, 2022) in four Dutch hospitals. A text mining algorithm for capturing disease progression was developed in hospitals 1 and 2 and then transferred to hospitals 3 and 4 to evaluate portability. Performance metrics were calculated by comparing its outcomes with manual chart review. In addition, data were simulated to come available over time to assess performance in real-time applications. Median progression-free survival (PFS) was calculated using the Kaplan-Meier method to compare text mining with manual chart review. RESULTS: During development and portability, the text mining algorithm performed well in capturing disease progression, with all performance scores >90%. When real-time performance was simulated, the performance scores in all four hospitals exceeded 90% from week 15 after the start of follow-up. Although the exact progression dates varied in 46 patients of 157 patients with progressive disease, the number of patients labeled with progression too early (n = 24) and too late (n = 22) was well balanced with discrepancies ranging from –116 to 384 days. Nevertheless, the PFS curves constructed with text mining and manual chart review were highly similar for each hospital. CONCLUSION: In this study, an accurate text mining algorithm for capturing disease progression in the EHR data of patients with mNSCLC was developed. The algorithm was portable across different hospitals, and the performance over time was good, making this an interesting approach for prospective follow-up of multicenter cohorts.Keywords
This publication has 17 references indexed in Scilit:
- Pembrolizumab Plus Chemotherapy Per PD-L1 Stratum In Patients With Metastatic Non–Small Cell Lung Cancer: Real-World Effectiveness Versus Trial EfficacyClinical Lung Cancer, 2023
- ESMO Guidance for Reporting Oncology real-World evidence (GROW)ESMO Real World Data and Digital Oncology, 2023
- Progression-free survival, disease-free survival and other composite end points in oncology: improved reporting is neededNature Reviews Clinical Oncology, 2023
- Real‐World Evidence in EU Medicines Regulation: Enabling Use and Establishing ValueClinical Pharmacology & Therapeutics, 2021
- An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell CarcinomaClinical Pharmacology & Therapeutics, 2020
- Generating Real-World Tumor Burden Endpoints from Electronic Health Record Data: Comparison of RECIST, Radiology-Anchored, and Clinician-Anchored Approaches for Abstracting Real-World Progression in Non-Small Cell Lung CancerAdvances in Therapy, 2019
- Frequentist versus Bayesian approaches to multiple testingEuropean Journal of Epidemiology, 2019
- The “Efficacy-Effectiveness Gap”: Historical Background and Current ConceptualizationValue in Health, 2016
- Information Extraction for Tracking Liver Cancer Patients' Statuses: From Mixture of Clinical Narrative Report TypesTelemedicine and e-Health, 2013
- Discerning Tumor Status from Unstructured MRI Reports—Completeness of Information in Existing Reports and Utility of Automated Natural Language ProcessingJournal of Digital Imaging, 2009