From patient care to research: a validation study examining the factors contributing to data quality in a primary care electronic medical record database
Open Access
- 5 February 2015
- journal article
- research article
- Published by Springer Nature in BMC Family Practice
- Vol. 16 (1) , 1-8
Abstract
Electronic Medical Records (EMRs) are increasingly used in the provision of primary care and have been compiled into databases which can be utilized for surveillance, research and informing practice. The primary purpose of these records is for the provision of individual patient care; validation and examination of underlying limitations is crucial for use for research and data quality improvement. This study examines and describes the validity of chronic disease case definition algorithms and factors affecting data quality in a primary care EMR database. A retrospective chart audit of an age stratified random sample was used to validate and examine diagnostic algorithms applied to EMR data from the Manitoba Primary Care Research Network (MaPCReN), part of the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). The presence of diabetes, hypertension, depression, osteoarthritis and chronic obstructive pulmonary disease (COPD) was determined by review of the medical record and compared to algorithm identified cases to identify discrepancies and describe the underlying contributing factors. The algorithm for diabetes had high sensitivity, specificity and positive predictive value (PPV) with all scores being over 90%. Specificities of the algorithms were greater than 90% for all conditions except for hypertension at 79.2%. The largest deficits in algorithm performance included poor PPV for COPD at 36.7% and limited sensitivity for COPD, depression and osteoarthritis at 72.0%, 73.3% and 63.2% respectively. Main sources of discrepancy included missing coding, alternative coding, inappropriate diagnosis detection based on medications used for alternate indications, inappropriate exclusion due to comorbidity and loss of data. Comparison to medical chart review shows that at MaPCReN the CPCSSN case finding algorithms are valid with a few limitations. This study provides the basis for the validated data to be utilized for research and informs users of its limitations. Analysis of underlying discrepancies provides the ability to improve algorithm performance and facilitate improved data quality.Keywords
This publication has 29 references indexed in Scilit:
- Evidence of prescription of antidepressants for non-psychiatric conditions in primary care: an analysis of guidelines and systematic reviewsBMC Family Practice, 2013
- Validation of the Diagnostic Algorithms for 5 Chronic Conditions in the Canadian Primary Care Sentinel Surveillance Network (CPCSSN): A Kingston Practice-based Research Network (PBRN) ReportThe Journal of the American Board of Family Medicine, 2013
- Patient, physician, encounter, and billing characteristics predict the accuracy of syndromic surveillance case definitionsBMC Public Health, 2012
- Describing the content of primary care: limitations of Canadian billing dataBMC Family Practice, 2012
- Using electronic medical records to determine the diagnosis of clinical depressionInternational Journal of Medical Informatics, 2011
- The Impact of eHealth on the Quality and Safety of Health Care: A Systematic OverviewPLOS Medicine, 2011
- What does validation of cases in electronic record databases mean? The potential contribution of free textPharmacoepidemiology and Drug Safety, 2011
- Comparison of GE Centricity Electronic Medical Record Database and National Ambulatory Medical Care Survey Findings on the Prevalence of Major Conditions in the United StatesPopulation Health Management, 2010
- Validity of registration of ICD codes and prescriptions in a research database in Swedish primary care: a cross-sectional study in Skaraborg primary care databaseBMC Medical Informatics and Decision Making, 2010
- Validity of diagnostic coding within the General Practice Research Database: a systematic reviewBritish Journal of General Practice, 2010