Using Patient-reported Outcomes (PROs) to Compare the Providers of Surgery
Authors:
- Andrew HutchingsAHAndrew Hutchings
- Jan van der MeulenJMJan van der Meulen
- Nick BlackNBNick Black
- 1 June 2013
- journal article
- research article
- Published by Wolters Kluwer Health in Medical Care
- Vol. 51 (6) , 517-523
Abstract
Patient-reported outcomes (PROs) are being used to compare health care providers with little knowledge of how the choice of measure affects such comparisons. To assess how much difference the choice of PRO makes to a provider's adjusted outcome and whether the choice affects a provider's rating. PROs collected in England from patients undergoing: hip replacement (243 providers; 52,692 patients); knee replacement (244; 60,118); varicose vein surgery (100; 11,163); and groin hernia repair (201; 31,714). Four case-mix-adjusted outcomes (mean postoperative disease-specific and generic PRO; proportion achieving a minimally important difference in disease-specific PRO; proportion reporting improvement on single transitional item). We calculated the associations between measures and for each measure, the proportion of providers rated as statistically above or below average and the level of agreement in ratings. For major surgery, disease-specific PROs were strongly correlated with the generic PRO (hip 0.90; knee 0.88), they rated high proportions of providers as above or below average (hip 25.1%; knee 19.3%) and there was agreement in ratings with the generic PRO. Even so, for a large proportion of providers (hip 30%; knee 16%) their rating depended on the choice of measure. For minor surgery, correlations between measures were mostly weak. The single transitional item identified the most outliers (varicose vein 20%, hernia 10%). Choice of outcome measure can determine a provider's rating. Measure selection depends on whether the priority is to avoid missing "poor" providers or avoid mislabeling average providers as "poor."Keywords
This publication has 19 references indexed in Scilit:
- Single item on patients’ satisfaction with condition provided additional insight into impact of surgeryJournal of Clinical Epidemiology, 2012
- The Need for Multiple Measures of Hospital QualityCirculation, 2011
- Variability in the Measurement of Hospital-wide Mortality RatesNew England Journal of Medicine, 2010
- Seniors’ self-reported multimorbidity captured biopsychosocial factors not incorporated into two other data-based morbidity measuresJournal of Clinical Epidemiology, 2009
- Hospital mortality: when failure is not a good measure of successCanadian Medical Association Journal, 2008
- Evaluation of Item CandidatesMedical Care, 2007
- Conflicting measures of hospital quality: Ratings from “Hospital Compare” versus “Best Hospitals”Journal of Hospital Medicine, 2007
- Developing the Patient-Reported Outcomes Measurement Information System (PROMIS)Medical Care, 2007
- Handling over-dispersion of performance indicatorsQuality and Safety in Health Care, 2005
- Funnel plots for comparing institutional performanceStatistics in Medicine, 2004