Multisite validation of a simple electronic health record algorithm for identifying diagnosed obstructive sleep apnea
- 15 February 2020
- journal article
- editorial
- Published by Springer Nature in Journal of Clinical Sleep Medicine
- Vol. 16 (2) , 175-183
Abstract
We examined the performance of a simple algorithm to accurately distinguish cases of diagnosed obstructive sleep apnea (OSA) and noncases using the electronic health record (EHR) across six health systems in the United States. Retrospective analysis of EHR data was performed. The algorithm defined cases as individuals with ≥ 2 instances of specific International Classification of Diseases (ICD)-9 and/or ICD-10 diagnostic codes (327.20, 327.23, 327.29, 780.51, 780.53, 780.57, G4730, G4733 and G4739) related to sleep apnea on separate dates in their EHR. Noncases were defined by the absence of these codes. Using chart reviews on 120 cases and 100 noncases at each site (n = 1,320 total), positive predictive value (PPV) and negative predictive value (NPV) were calculated. The algorithm showed excellent performance across sites, with a PPV (95% confidence interval) of 97.1 (95.6, 98.2) and NPV of 95.5 (93.5, 97.0). Similar performance was seen at each site, with all NPV and PPV estimates ≥ 90% apart from a somewhat lower PPV of 87.5 (80.2, 92.8) at one site. A modified algorithm of ≥ 3 instances improved PPV to 94.9 (88.5, 98.3) at this site, but excluded an additional 18.3% of cases. Thus, performance may be further improved by requiring additional codes, but this reduces the number of determinate cases. A simple EHR-based case-identification algorithm for diagnosed OSA showed excellent predictive characteristics in a multisite sample from the United States. Future analyses should be performed to understand the effect of undiagnosed disease in EHR-defined noncases. This algorithm has wide-ranging applications for EHR-based OSA research. Keenan BT, Kirchner HL, Veatch OJ, et al. Multisite validation of a simple electronic health record algorithm for identifying diagnosed obstructive sleep apnea. J Clin Sleep Med. 2020;16(2):175–183.Keywords
This publication has 28 references indexed in Scilit:
- An Official American Thoracic Society Statement: Continuous Positive Airway Pressure Adherence Tracking Systems. The Optimal Monitoring Strategies and Outcome Measures in AdultsAmerican Journal of Respiratory and Critical Care Medicine, 2013
- Association of Obstructive Sleep Apnea With Risk of Serious Cardiovascular EventsCirculation: Cardiovascular Quality and Outcomes, 2012
- High STOP-Bang score indicates a high probability of obstructive sleep apnoeaBritish Journal of Anaesthesia, 2012
- Sleep-Disordered Breathing, Hypoxia, and Risk of Mild Cognitive Impairment and Dementia in Older WomenJAMA, 2011
- Obstructive Sleep Apnea–Hypopnea and Incident Stroke: The Sleep Heart Health StudyAmerican Journal of Respiratory and Critical Care Medicine, 2010
- Prevalence of undiagnosed obstructive sleep apnea among adult surgical patients in an academic medical centerSleep Medicine, 2009
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Estimating sensitivity and specificity from positive predictive value, negative predictive value and prevalence: application to surveillance systems for hospital-acquired infectionsJournal of Hospital Infection, 2008
- The Epidemiology of Adult Obstructive Sleep ApneaProceedings of the American Thoracic Society, 2008
- Measuring Diagnoses: ICD Code AccuracyHealth Services Research, 2005