Consensus Methods to Identify a Set of Potential Performance Indicators for Systems of Emergency and Urgent Care
- 1 April 2010
- journal article
- Published by SAGE Publications in Journal of Health Services Research & Policy
- Vol. 15 (2_suppl) , 12-18
Abstract
Objectives To identify a comprehensive set of indicators to enable Primary Care Trust (PCT) commissioners in England and other NHS decision-makers to monitor the performance of systems of emergency and urgent care for which they are responsible. Methods Using a combination of Delphi RAND methods in three successive rounds of consultation and nominal group review, we canvassed expert opinion on 70 potential indicators as good measures of system performance. The two Delphi panels consisted of senior clinicians and researchers, and urgent care leads and commissioners in PCTs and Strategic Health Authorities (SHAs). The indicators were formatted into a questionnaire according to whether they were outcome, process, structure, or equity-based measures. Participants scored each indicator on a Likert scale of 1–9 and had the opportunity to consider their scores informed by the group scores and feedback. The questionnaire was refined after each round. To ensure that the indicators rated most highly by the Delphi panels covered all dimensions of performance, the results of the Delphi were reviewed by a nominal group consisting of two researchers and three clinicians from the local health services research network (LHSR). Results Overall, the process yielded 16 candidate indicators. It also produced a core set of serious, emergency and urgent care-sensitive conditions (defined as conditions whose exacerbations should be managed by a well-performing system without admission to an inpatient bed), for use with the indicators. Conclusions System-wide measures to monitor performance across multiple services should encourage providers to work for patient benefit in an integrated way. They will also assist commissioners to monitor and improve emergency and urgent care for their local populations. The indicators are now being calculated using routinely available data, and tested for their responsiveness to capture change over time.Keywords
This publication has 14 references indexed in Scilit:
- Characteristics of the Emergency and Urgent Care System Important to Patients: A Qualitative StudyJournal of Health Services Research & Policy, 2008
- An integrated care pathway for menorrhagia across the primary-secondary interface: patients' experience, clinical outcomes, and service utilisationQuality and Safety in Health Care, 2007
- Treating the clock and not the patient: ambulance response times and riskQuality and Safety in Health Care, 2006
- Targets and moving goal posts: changes in waiting times in a UK emergency departmentEmergency Medicine Journal, 2005
- Performance Indicators: Good, Bad, and UglyJournal of the Royal Statistical Society Series A: Statistics in Society, 2004
- A Delphi study to identify performance indicators for emergency medicineEmergency Medicine Journal, 2004
- Randomised controlled trial of a shared care programme for newly referred cancer patients: bridging the gap between general practice and hospitalQuality and Safety in Health Care, 2003
- Measuring “goodness” in individuals and healthcare systemsBMJ, 2002
- Mortality among Patients Admitted to Hospitals on Weekends as Compared with WeekdaysNew England Journal of Medicine, 2001
- Left in limbo: patients' views on care across the primary/secondary interfaceQuality and Safety in Health Care, 1999