Governing patient safety: lessons learned from a mixed methods evaluation of implementing a ward-level medication safety scorecard in two English NHS hospitals
Open Access
- 12 September 2013
- journal article
- research article
- Published by BMJ in BMJ Quality & Safety
- Vol. 23 (2) , 136-146
Abstract
Background Relatively little is known about how scorecards presenting performance indicators influence medication safety. We evaluated the effects of implementing a ward-level medication safety scorecard piloted in two English NHS hospitals and factors influencing these. Methods We used a mixed methods, controlled before and after design. At baseline, wards were audited on medication safety indicators; during the ‘feedback’ phase scorecard results were presented to intervention wards on a weekly basis over 7 weeks. We interviewed 49 staff, including clinicians and managers, about scorecard implementation. Results At baseline, 18.7% of patients (total n=630) had incomplete allergy documentation; 53.4% of patients (n=574) experienced a drug omission in the preceding 24 h; 22.5% of omitted doses were classified as ‘critical’; 22.1% of patients (n=482) either had ID wristbands not reflecting their allergy status or no ID wristband; and 45.3% of patients (n=237) had drugs that were either unlabelled or labelled for another patient in their drug lockers. The quantitative analysis found no significant improvement in intervention wards following scorecard feedback. Interviews suggested staff were interested in scorecard feedback and described process and culture changes. Factors influencing scorecard implementation included ‘normalisation’ of errors, study duration, ward leadership, capacity to engage and learning preferences. Discussion Presenting evidence-based performance indicators may potentially influence staff behaviour. Several practical and cultural factors may limit feedback effectiveness and should be considered when developing improvement interventions. Quality scorecards should be designed with care, attending to evidence of indicators’ effectiveness and how indicators and overall scorecard composition fit the intended audience.Keywords
This publication has 51 references indexed in Scilit:
- More quality measures versus measuring what matters: a call for balance and parsimonyBMJ Quality & Safety, 2012
- Ten challenges in improving quality in healthcare: lessons from the Health Foundation's programme evaluations and relevant literature: Table 1BMJ Quality & Safety, 2012
- Explaining Michigan: Developing an Ex Post Theory of a Quality Improvement ProgramThe Milbank Quarterly, 2011
- The Influence of Context on Quality Improvement Success in Health Care: A Systematic Review of the LiteratureThe Milbank Quarterly, 2010
- Doctors and quality improvementJournal of the Royal Society of Medicine, 2009
- Meta-AnalysisMedical Care, 2009
- CIHR Research: How to Translate Health Research Knowledge into Effective Healthcare ActionWorld Health & Population, 2007
- The in-between world of knowledge brokeringBMJ, 2007
- Understanding the complexity of redesigning care around the clinical microsystemQuality and Safety in Health Care, 2006
- The Incidence of Prescribing Errors in Hospital InpatientsDrug Safety, 2005