Generalizability of Indicators from the New York City Macroscope Electronic Health Record Surveillance System to Systems Based on Other EHR Platforms
Authors:
- Katharine H. McVeighKMKatharine H. McVeigh
- Elizabeth Lurie-MoroniELElizabeth Lurie-Moroni
- Pui Ying ChanPCPui Ying Chan
- Remle Newton-DameRNRemle Newton-Dame
- Lauren SchreibsteinLSLauren Schreibstein
- Kathleen S. TatemKTKathleen S. Tatem
- Matthew L. RomoMRMatthew L. Romo
- Lorna E. ThorpeLTLorna E. Thorpe
- Sharon E. PerlmanSPSharon E. Perlman
Open Access
- 16 May 2017
- journal article
- Published by Ubiquity Press, Ltd. in eGEMs (Generating Evidence & Methods to improve patient outcomes)
- Vol. 5 (1) , 25
Abstract
The New York City (NYC) Macroscope is an electronic health record (EHR) surveillance system based on a distributed network of primary care records from the Hub Population Health System. In a previous 3-part series published in eGEMS, we reported the validity of health indicators from the NYC Macroscope; however, questions remained regarding their generalizability to other EHR surveillance systems. We abstracted primary care chart data from more than 20 EHR software systems for 142 participants of the 2013-14 NYC Health and Nutrition Examination Survey who did not contribute data to the NYC Macroscope. We then computed the sensitivity and specificity for indicators, comparing data abstracted from EHRs with survey data. Obesity and diabetes indicators had moderate to high sensitivity (0.81-0.96) and high specificity (0.94-0.98). Smoking status and hypertension indicators had moderate sensitivity (0.78-0.90) and moderate to high specificity (0.88-0.98); sensitivity improved when the sample was restricted to records from providers who attested to Stage 1 Meaningful Use. Hyperlipidemia indicators had moderate sensitivity (≥0.72) and low specificity (≤0.59), with minimal changes when restricting to Stage 1 Meaningful Use. Indicators for obesity and diabetes used in the NYC Macroscope can be adapted to other EHR surveillance systems with minimal validation. However, additional validation of smoking status and hypertension indicators is recommended and further development of hyperlipidemia indicators is needed. Our findings suggest that many of the EHR-based surveillance indicators developed and validated for the NYC Macroscope are generalizable for use in other EHR surveillance systems.Keywords
This publication has 38 references indexed in Scilit:
- Characterizing Adults Receiving Primary Medical Care in New York City: Implications for Using Electronic Health Records for Chronic Disease SurveillancePreventing Chronic Disease, 2016
- Are We Asking Patients if They Smoke?American Journal of Preventive Medicine, 2015
- Validity of diabetes self-reports in the Women’s Health InitiativeMenopause, 2014
- Validity of smoking prevalence estimates from primary care electronic health records compared with national population survey data for England, 2007 to 2011Pharmacoepidemiology and Drug Safety, 2013
- Use of Practice-Based Research Network Data to Measure Neighborhood Smoking PrevalencePreventing Chronic Disease, 2013
- Can data from primary care medical records be used to monitor national smoking prevalence?Journal of Epidemiology and Community Health, 2011
- Measuring morbidity: self-report or health care records?Family Practice, 2009
- Epidemiological usefulness of population-based electronic clinical records in primary care: estimation of the prevalence of chronic diseasesFamily Practice, 2009
- Validation of self-reported chronic conditions and health services in a managed care population11The full text of this article is available at http://www.elsevier.com/locate/ajpmonline.American Journal of Preventive Medicine, 2000
- An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple ObserversBiometrics, 1977