Are administrative data valid when measuring patient safety in hospitals? A comparison of data collection methods using a chart review and administrative data
Authors:
- 1 July 2015
- journal article
- research article
- Published by Oxford University Press (OUP) in International Journal for Quality in Health Care
- Vol. 27 (4) , 305-313
Abstract
Objective To evaluate the validity and reliability of German Diagnosis Related Group administrative data to measure indicators of patient safety in comparison to clinical records. Design A cross-sectional study was conducted using chart review (CR) as gold standard and screening of associated administrative data based on DRG coding. Setting Three German somatic acute care hospitals for adults. Participants A total of 3000 cases treated between May and December, 2010. Main outcome measures Eight indicators were used to analyse the incidence of associated adverse events (AEs): pressure ulcers, catheter-related infections, respiratory failure, deep vein thromboses, hospital-acquired pneumonia, acute renal failure, acute myocardial infarction and wound infections. We calculated sensitivity, specificity, positive predictive value (PPV) and Cohen's Kappa with 95% confidence intervals. Results Screening of administrative data identified 171 AEs and 456 were identified by CR. A number of 135 identical events were identified by both methods. Sensitivities for the detection of AEs using administrative data ranged from 6 to 100%. Specificities ranged from 99 to 100%. PPV were 33 to 100% and reliabilities were 12 to 85%. Conclusions Indicators based on German administrative data deviate widely from indicators based on clinical data. Therefore, hospitals should be cautious to use indicators based on administrative data for quality assurance. However, some might be useful for case findings and quality improvement. The precision of the evaluated indicators needs further development to detect AEs by the valid use of administrative data.Keywords
This publication has 23 references indexed in Scilit:
- Detecting adverse events in surgery: comparing events detected by the Veterans Health Administration Surgical Quality Improvement Program and the Patient Safety IndicatorsThe American Journal of Surgery, 2014
- Validity of AHRQ patient safety indicators derived from ICD-10 hospital discharge abstract data (chart review study)BMJ Open, 2013
- Meeting the ambition of measuring the quality of hospitals' stroke care using routinely collected administrative data: a feasibility studyInternational Journal for Quality in Health Care, 2013
- Concordance and robustness of quality indicator sets for hospitals: an analysis of routine dataBMC Health Services Research, 2011
- Temporal Trends in Rates of Patient Harm Resulting from Medical CareNew England Journal of Medicine, 2010
- Evaluation of the predictive value of ICD-9-CM coded administrative data for venous thromboembolism in the United StatesThrombosis Research, 2010
- Validity of Selected AHRQ Patient Safety Indicators Based on VA National Surgical Quality Improvement Program DataHealth Services Research, 2009
- Zur Messung und Darstellung von medizinischer Ergebnisqualität mit administrativen Routinedaten in DeutschlandBundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz, 2008
- The hazards of hospitalizationQuality and Safety in Health Care, 2003
- Nosocomial and community-acquired infections in Germany. Summary of the results of the first national prevalence study (NIDEP)Infection, 1997