Process monitoring in intensive care with the use of cumulative expected minus observed mortality and risk-adjusted p charts
Open Access
- 14 February 2006
- journal article
- research article
- Published by Springer Nature in Critical Care
- Vol. 10 (1) , R28
Abstract
Introduction: A health care system is a complex adaptive system. The effect of a single intervention, incorporated into a complex clinical environment, may be different from that expected. A national database such as the Intensive Care National Audit & Research Centre (ICNARC) Case Mix Programme in the UK represents a centralised monitoring, surveillance and reporting system for retrospective quality and comparative audit. This can be supplemented with real-time process monitoring at a local level for continuous process improvement, allowing early detection of the impact of both unplanned and deliberately imposed changes in the clinical environment. Methods: Demographic and UK Acute Physiology and Chronic Health Evaluation II (APACHE II) data were prospectively collected on all patients admitted to a UK regional hospital between 1 January 2003 and 30 June 2004 in accordance with the ICNARC Case Mix Programme. We present a cumulative expected minus observed (E-O) plot and the risk-adjusted p chart as methods of continuous process monitoring. We describe the construction and interpretation of these charts and show how they can be used to detect planned or unplanned organisational process changes affecting mortality outcomes. Results: Five hundred and eighty-nine adult patients were included. The overall death rate was 0.78 of predicted. Calibration showed excess survival in ranges above 30% risk of death. The E-O plot confirmed a survival above that predicted. Small transient variations were seen in the slope that could represent random effects, or real but transient changes in the quality of care. The risk-adjusted p chart showed several observations below the 2 SD control limits of the expected mortality rate. These plots provide rapid analysis of risk-adjusted performance suitable for local application and interpretation. The E-O chart provided rapid easily visible feedback of changes in risk-adjusted mortality, while the risk-adjusted p chart allowed statistical evaluation. Conclusion: Local analysis of risk-adjusted mortality data with an E-O plot and a risk-adjusted p chart is feasible and allows the rapid detection of changes in risk-adjusted outcome of intensive care patients. This complements the centralised national database, which is more archival and comparative in nature.Keywords
This publication has 36 references indexed in Scilit:
- Real-time monitoring of coronary care mortality: A comparison and combination of two monitoring toolsInternational Journal of Cardiology, 2005
- An Overview of Risk-Adjusted ChartsJournal of the Royal Statistical Society Series A: Statistics in Society, 2004
- A risk‐adjusted Sets method for monitoring adverse medical outcomesStatistics in Medicine, 2004
- Retrospective cohort study of false alarm rates associated with a series of heart operations: the case for hospital mortality monitoring groupsBMJ, 2004
- Risk-Adjusted Monitoring of Binary Surgical OutcomesMedical Decision Making, 2001
- Risk-Adjusted Monitoring of Binary Surgical OutcomesMedical Decision Making, 2001
- Monitoring surgical performance using risk-adjusted cumulative sum chartsBiostatistics, 2000
- Intensive Care Societyʼs Acute Physiology and Chronic Health Evaluation (APACHE II) study in Britain and IrelandCritical Care Medicine, 1994
- Monitoring intensive care unit performance using statistical quality control chartsJournal of Clinical Monitoring and Computing, 1993
- APACHE IICritical Care Medicine, 1985