Using Natural Language Processing of Clinical Notes to Supplement Structured Electronic Health Record Data for Phenotyping Smoking and Obesity in a Healthcare System
Preprint
Abstract
Purpose: Studies based on electronic health records (EHR) often rely on structured data, which may incompletely capture important clinical phenotypes in EHR notes. The purpose of this study was to assess two natural language processing (NLP) tools to extract phenotypes from unstructured EHR notes, and to evaluate the added value of integrating NLP-derived phenotypes with structured EHR data at a health system scale. Methods: This retrospective study is based on inpatient and outpatient EHR data from the Mass General Brigham healthcare system between January 1, 2019 and December 31, 2020. Two established rule-based NLP tools were applied to extract smoking and obesity information from 19,215,303 clinical notes of 503,025 patients. NLP performance was evaluated through manual review of stratified samples. Phenotype prevalence was estimated using structured EHR data alone and compared with prevalence estimates obtained by supplementing structured data with NLP-derived features. Results: Both NLP tools exhibited high performance, with both accuracy and F1 score of 0.99 for smoking, and 0.92 and 0.91 for obesity, respectively. The combination of NLP and structured data identified 220,714 patients (43.88%) with smoking, compared with 170,396 patients (33.87%) identified using structured data alone, representing a 29.5% relative increase. For obesity, NLP identified 121,360 patients (24.13%) from EHR notes, and 169,905 patients (33.78%) were documented in structured data; inclusion of NLP-derived features contributed additional 32,823 patients, corresponding to a 19.3% relative increase. Conclusion: NLP-derived phenotypes from unstructured EHR notes substantially improve patient identification for both smoking and obesity compared with structured EHR data alone at scale.Keywords
This publication has 12 references indexed in Scilit:
- Scalable medication extraction and discontinuation identification from electronic health records using large language modelsJournal of Clinical Epidemiology, 2025
- Natural language processing for scalable feature engineering and ultra-high-dimensional confounding adjustment in healthcare database studiesJournal of Biomedical Informatics, 2025
- Comparative ranking of marginal confounding impact of natural language processing-derived versus structured features in pharmacoepidemiologyComputers in Biology and Medicine, 2025
- The FDA Sentinel Real World Evidence Data Enterprise (RWE‐DE)Pharmacoepidemiology and Drug Safety, 2024
- Use of Electronic Health Record Data for Drug Safety Signal Identification: A Scoping ReviewDrug Safety, 2023
- Missing data matter: an empirical evaluation of the impacts of missing EHR data in comparative effectiveness researchJournal of the American Medical Informatics Association, 2023
- Methods for drug safety signal detection using routinely collected observational electronic health care data: A systematic reviewPharmacoepidemiology and Drug Safety, 2022
- Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health recordsJournal of the American Medical Informatics Association, 2017
- A novel algorithm for detection of adverse drug reaction signals using a hospital electronic medical record databasePharmacoepidemiology and Drug Safety, 2011
- Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applicationsJournal of the American Medical Informatics Association, 2010