Ensemble of trees approaches to risk adjustment for evaluating a hospital’s performance
Authors:
- 29 April 2014
- journal article
- research article
- Published by Springer Nature in Health Care Management Science
- Vol. 18 (1) , 58-66
Abstract
A commonly used method for evaluating a hospital’s performance on an outcome is to compare the hospital’s observed outcome rate to the hospital’s expected outcome rate given its patient (case) mix and service. The process of calculating the hospital’s expected outcome rate given its patient mix and service is called risk adjustment (Iezzoni 1997). Risk adjustment is critical for accurately evaluating and comparing hospitals’ performances since we would not want to unfairly penalize a hospital just because it treats sicker patients. The key to risk adjustment is accurately estimating the probability of an Outcome given patient characteristics. For cases with binary outcomes, the method that is commonly used in risk adjustment is logistic regression. In this paper, we consider ensemble of trees methods as alternatives for risk adjustment, including random forests and Bayesian additive regression trees (BART). Both random forests and BART are modern machine learning methods that have been shown recently to have excellent performance for prediction of outcomes in many settings. We apply these methods to carry out risk adjustment for the performance of neonatal intensive care units (NICU). We show that these ensemble of trees methods outperform logistic regression in predicting mortality among babies treated in NICU, and provide a superior method of risk adjustment compared to logistic regression.Keywords
This publication has 26 references indexed in Scilit:
- Probability MachinesMethods of Information in Medicine, 2012
- Percentile-Based Empirical Distribution Function Estimates for Performance Evaluation of Healthcare ProvidersJournal of the Royal Statistical Society Series C: Applied Statistics, 2011
- Predicting in vitro drug sensitivity using Random ForestsBioinformatics, 2010
- Outlier detection for a hierarchical Bayes model in a study of hospital variation in surgical proceduresStatistical Methods in Medical Research, 2010
- Bayesian and Frequentist Methods for Provider Profiling Using Risk-Adjusted Assessments of Medical OutcomesJournal of the American Statistical Association, 2010
- Matching Methods for Causal Inference: A Review and a Look ForwardStatistical Science, 2010
- Bayes rules for optimally using Bayesian hierarchical regression models in provider profiling to identify high-mortality hospitalsBMC Medical Research Methodology, 2008
- Statistical and Clinical Aspects of Hospital Outcomes ProfilingStatistical Science, 2007
- Random Forest: A Classification and Regression Tool for Compound Classification and QSAR ModelingJournal of Chemical Information and Computer Sciences, 2003
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983