A Simple Insightful Approach to Investigating a Hospital Standardised Mortality Ratio: An Illustrative Case-Study
Open Access
- 5 March 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 8 (3) , e57845
Abstract
Despite methodological concerns Hospital Standardised Mortality Ratios (HSMRs) are promoted as measures of performance. Hospitals that experience an increase in their HSMR are presented with a serious challenge but with little guidance on how to investigate this complex phenomenon. We illustrate a simple penetrating approach. Retrospective analysis of routinely collected hospital admissions data comparing observed and expected deaths predicted by the Dr Foster Unit case mix adjustment method over three years (n = 74,860 admissions) in Shropshire and Telford NHS Trust Hospital (SaTH) constituting PRH (Princess Royal Hospital) and RSH (Royal Shrewsbury Hospital); whose HSMR increased from 99 in the year 2008/09 to 118 in the year 2009/10. The step up in HSMR was primarily located in PRH (109 to 130 vs. 105 to 118 RSH). Disentangling the HSMR by plotting run charts of observed and expected deaths showed that observed deaths were stable in RSH and PRH but expected deaths, especially at PRH, had fallen. The fall in expected deaths has two possible explanations–genuinely lower risk admissions or that the case-mix adjustment model is underestimating the risk of admissions perhaps because of inadequate clinical coding. There was no evidence that the case-mix profile of admissions had changed but there was considerable evidence that clinical coding process at PRH was producing a lower depth of coding resulting in lower expected mortality. Knowing whether the change (increase/decrease) in HSMR is driven by the numerator or the denominator is a crucial pivotal first step in understanding a given HSMR and so such information should be an integral part of the HSMR reporting methodology.Keywords
This publication has 22 references indexed in Scilit:
- Strengths and weaknesses of hospital standardised mortality ratiosBMJ, 2010
- What to do with outliers?2006
- An investigation into GPs with high patient mortality rates: a retrospective studyJournal of Public Health, 2005
- Surgery for congenital heart conditions in OxfordBMJ, 2005
- Paediatric cardiac surgical mortality in England after Bristol: descriptive analysis of hospital episode statistics 1991-2002BMJ, 2004
- An investigation into general practitioners associated with high patient mortality flagged up through the Shipman inquiry: retrospective analysis of routine dataBMJ, 2004
- Following Shipman: a pilot system for monitoring mortality rates in primary careThe Lancet, 2003
- Explaining differences in English hospital death rates using routinely collected dataBMJ, 1999
- The risks of risk adjustmentJAMA, 1997
- A new method of classifying prognostic comorbidity in longitudinal studies: Development and validationJournal of Chronic Diseases, 1987