Comparison of EHR-based diagnosis documentation locations to a gold standard for risk stratification in patients with multiple chronic conditions
Open Access
- 1 July 2017
- journal article
- research article
- Published by Georg Thieme Verlag KG in Applied Clinical Informatics
- Vol. 08 (03) , 794-809
Abstract
Summary: Objective: To measure variation among four different Electronic Health Record (EHR) system documentation locations versus ‘gold standard’ manual chart review for risk stratification in patients with multiple chronic illnesses. Methods: Adults seen in primary care with EHR evidence of at least one of 13 conditions were included. EHRs were manually reviewed to determine presence of active diagnoses, and risk scores were calculated using three different methodologies and five EHR documentation locations. Claims data were used to assess cost and utilization for the following year. Descriptive and diagnostic statistics were calculated for each EHR location. Criterion validity testing compared the gold standard verified diagnoses versus other EHR locations and risk scores in predicting future cost and utilization. Results: Nine hundred patients had 2,179 probable diagnoses. About 70% of the diagnoses from the EHR were verified by gold standard. For a subset of patients having baseline and prediction year data (n=750), modeling showed that the gold standard was the best predictor of outcomes on average for a subset of patients that had these data. However, combining all data sources together had nearly equivalent performance for prediction as the gold standard. Conclusions: EHR data locations were inaccurate 30% of the time, leading to improvement in overall modeling from a gold standard from chart review for individual diagnoses. However, the impact on identification of the highest risk patients was minor, and combining data from different EHR locations was equivalent to gold standard performance.Martin S, Wagner J, Lupulescu-Mann N et al. Comparison of EHR-based diagnosis documentation locations to a gold standard for risk stratification in patients with multiple chronic conditions . Appl Clin Inform 2017; 8: 794–809 https://doi.org/10.4338/ACI-2016-12-RA-0210Keywords
Funding Information
- Agency for Healthcare Research and Quality (1R21HS023091–01)
This publication has 13 references indexed in Scilit:
- A Quasi-Monte-Carlo Comparison of Parametric and Semiparametric Regression Methods for Heavy-tailed and Non-normal Data: an Application to Healthcare CostsJournal of the Royal Statistical Society Series A: Statistics in Society, 2015
- Problem list completeness in electronic health records: A multi-site study and assessment of success factorsInternational Journal of Medical Informatics, 2015
- Chronic Kidney Disease in an Electronic Health Record Problem List: Quality of Care, ESRD, and MortalityAmerican Journal of Nephrology, 2014
- Development and use of active clinical decision support for preemptive pharmacogenomicsJournal of the American Medical Informatics Association, 2014
- Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical researchJournal of the American Medical Informatics Association, 2013
- Risk Prediction Models for Hospital ReadmissionJAMA, 2011
- 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical textJournal of the American Medical Informatics Association, 2011
- Identifying Patient Smoking Status from Medical Discharge RecordsJournal of the American Medical Informatics Association, 2008
- Use of Health‐Related, Quality‐of‐Life Metrics to Predict Mortality and Hospitalizations in Community‐Dwelling SeniorsJournal of the American Geriatrics Society, 2006
- Validation of diagnostic codes within medical services claimsJournal of Clinical Epidemiology, 2004