Natural language processing for the assessment of cardiovascular disease comorbidities: The cardio‐Canary comorbidity project
Open Access
- 4 August 2021
- journal article
- research article
- Published by Wiley in Clinical Cardiology
- Vol. 44 (9) , 1296-1304
Abstract
Objective: Accurate ascertainment of comorbidities is paramount in clinical research. While manual adjudication is labor‐intensive and expensive, the adoption of electronic health records enables computational analysis of free‐text documentation using natural language processing (NLP) tools.Hypothesis: We sought to develop highly accurate NLP modules to assess for the presence of five key cardiovascular comorbidities in a large electronic health record system.Methods: One‐thousand clinical notes were randomly selected from a cardiovascular registry at Mass General Brigham. Trained physicians manually adjudicated these notes for the following five diagnostic comorbidities: hypertension, dyslipidemia, diabetes, coronary artery disease, and stroke/transient ischemic attack. Using the open‐source Canary NLP system, five separate NLP modules were designed based on 800 “training‐set” notes and validated on 200 “test‐set” notes.Results: Across the five NLP modules, the sentence‐level and note‐level sensitivity, specificity, and positive predictive value was always greater than 85% and was most often greater than 90%. Accuracy tended to be highest for conditions with greater diagnostic clarity (e.g. diabetes and hypertension) and slightly lower for conditions whose greater diagnostic challenges (e.g. myocardial infarction and embolic stroke) may lead to less definitive documentation.Conclusion: We designed five open‐source and highly accurate NLP modules that can be used to assess for the presence of important cardiovascular comorbidities in free‐text health records. These modules have been placed in the public domain and can be used for clinical research, trial recruitment and population management at any institution as well as serve as the basis for further development of cardiovascular NLP tools.Keywords
This publication has 28 references indexed in Scilit:
- Validity of Administrative Data for Identifying Patients Who Have Had a Stroke or Transient Ischemic Attack Using EMRALD as a Reference StandardCanadian Journal of Cardiology, 2013
- Automated Detection Using Natural Language Processing of Radiologists Recommendations for Additional Imaging of Incidental FindingsAnnals of Emergency Medicine, 2013
- Discontinuation of Statins in Routine Care SettingsAnnals of Internal Medicine, 2013
- Identifying primary and recurrent cancers using a SAS-based natural language processing algorithmJournal of the American Medical Informatics Association, 2013
- Ascertainment of chronic diseases using population health data: a comparison of health administrative data and patient self-reportBMC Public Health, 2013
- Identification of methicillin-resistant Staphylococcus aureus within the Nation’s Veterans Affairs Medical Centers using natural language processingBMC Medical Informatics and Decision Making, 2012
- A systematic review of validated methods for identifying heart failure using administrative dataPharmacoepidemiology and Drug Safety, 2012
- Natural language processing: an introductionJournal of the American Medical Informatics Association, 2011
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Natural language processing to extract medical problems from electronic clinical documents: Performance evaluationJournal of Biomedical Informatics, 2006