Individual and Clustered Rankability of ICUs According to Case-Mix–Adjusted Mortality*
Authors:
- Nicolette F. de KeizerNKNicolette F. de Keizer
- Rebecca HolmanRHRebecca Holman
- Dave DongelmansDDDave Dongelmans
- Evert de JongeEJEvert de Jonge
- Niels PeekNPNiels Peek
- 1 May 2016
- journal article
- Published by Wolters Kluwer Health in Critical Care Medicine
- Vol. 44 (5) , 901-909
Abstract
The performance of ICUs can be compared by ranking them into a league table according to their risk-adjusted mortality rate. The statistical quality of a league table can be expressed as its rankability, the percentage of variation between ICUs attributable to unexplained differences. We examine whether we can improve the rankability of our league table by using data from a longer period or by grouping ICUs with similar performance constructing a league table of clusters rather than individual ICUs.We developed a league table for risk-adjusted mortality rate with its rankability. The effect of assessment period was determined using a resampling procedure. Hierarchical clustering was used to obtain clusters of similar ICUs.We used data from ICUs participating in the Dutch National Intensive Care Evaluation registry between 2011 and 2013.We constructed league tables using 157,394 admissions from 78 ICUs with risk-adjusted mortality rate between 5.9% and 13.9% per ICU over the inclusion period. The rankability was 73% for 2013 and 89% for the whole period 2011-2013. Rankability over the year 2013 increased till 98% when clustering ICUs, reaching an optimum at a league table of seven clusters.We conclude that, when using data from a single year, the rankability of a league table of Dutch ICUs based on risk-adjusted mortality rate was unacceptably low. We could improve the rankability of this league table by increasing the period of data collection or by grouping similar ICUs into clusters and constructing a league table of clusters of ICUs rather than individual ICUs. Ranking clusters of ICUs could be useful for identifying possible differences in performance between clusters of ICUs.Keywords
This publication has 23 references indexed in Scilit:
- Focusing on desired outcomes of care after colon cancer resections; hospital variations in ‘textbook outcome’European Journal of Surgical Oncology, 2013
- Limitations of Ranking Lists Based on Cardiac Surgery Mortality RatesCirculation: Cardiovascular Quality and Outcomes, 2012
- League Tables of Breast Cancer Screening Units: Worst-case and Best-case Scenario Ratings Helped in Exposing Real Differences between Performance RatingsJournal of Medical Screening, 2009
- Outcome prediction in critical care: the Acute Physiology and Chronic Health Evaluation modelsCurrent Opinion in Critical Care, 2008
- Acute Physiology and Chronic Health Evaluation (APACHE) IV: Hospital mortality assessment for today’s critically ill patients*Critical Care Medicine, 2006
- Funnel plots for comparing institutional performanceStatistics in Medicine, 2004
- Using indicators to quantify the potential to improve the quality of health careInternational Journal for Quality in Health Care, 2004
- League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional PerformanceJournal of the Royal Statistical Society Series A: Statistics in Society, 1996
- A New Simplified Acute Physiology Score (SAPS II) Based on a European/North American Multicenter StudyJAMA, 1993
- APACHE IICritical Care Medicine, 1985