Evaluation of an instrument to measure teamwork in multidisciplinary critical care teams
- 5 January 2011
- journal article
- Published by BMJ in BMJ Quality & Safety
- Vol. 20 (3) , 216-222
Abstract
Introduction Teamwork failures contribute to adverse events causing harm to patients. Establishing and maintaining a team and managing the tasks are active processes. Medical education largely ignores teamwork skills. However, lack of robust instruments to measure teamwork limits evaluation of interventions to improve it. The authors aimed to develop and validate an instrument to measure teamwork behaviours. Methods From existing literature, the authors developed an instrument, gaining rater consensus that the final 23 items were comprehensive, comprehensible and observable. Data on the instrument were obtained from three expert raters who scored videotaped simulations of 40 critical care teams (one doctor, three nurses) participating in four simulated emergencies. Exploratory Factor Analysis, Generalisability Analysis and rater interviews on assessor performance provided information on the properties of the instrument. Results Exploratory Factor Analysis found items clustered into three factors: Leadership and Team Coordination; Mutual Performance Monitoring; and Verbalising Situational Information. Internal consistencies (Cronbach's α) for these factors were 0.917, 0.915 and 0.893, respectively. The Generalisability coefficient for overall team behaviour was 0.78 and the G coefficients for the three factors were 0.85, 0.4 and 0.37, respectively. Variance Components and interview data provided insight into individual item performance. Significantly improved performance with time and seniority supported construct validity. Discussion The instrument performed well as an overall measure of team behaviour and reflected three dimensions of teamwork. Triangulation of information on the instrument, the factors and individual items will allow a methodical and informed approach to further development of the instrument. The ultimate goal is an instrument that can robustly evaluate interventions to improve team function in healthcare.Keywords
This publication has 26 references indexed in Scilit:
- Communication skills and error in the intensive care unitCurrent Opinion in Critical Care, 2007
- The Mayo High Performance Teamwork Scale: Reliability and Validity for Evaluating Key Crew Resource Management SkillsSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2007
- Teaching antiarrhythmic therapy and ECG in simulator-based interdisciplinary undergraduate medical educationBritish Journal of Anaesthesia, 2005
- Anaesthetists’ Non-Technical Skills (ANTS): evaluation of a behavioural marker system † †Declaration of interest: The ANTS system was developed under research funding from the Scottish Council for Postgraduate Medical and Dental Education, now part of NHS Education for Scotland, through grants to the University of Aberdeen from September 1999 to August 2003. The views presented in this paper are those of the authors and should not be taken to represent the position or policy of the funding body.British Journal of Anaesthesia, 2003
- Evaluation of high fidelity patient simulator in assessment of performance of anaesthetistsBritish Journal of Anaesthesia, 2003
- Generalisability: a key to unlock professional assessmentMedical Education, 2002
- The Potential for Improved Teamwork to Reduce Medical Errors in the Emergency DepartmentAnnals of Emergency Medicine, 1999
- Assessment of Clinical Performance during Simulated Crises Using Both Technical and Behavioral RatingsAnesthesiology, 1998
- Objective structured assessment of technical skill (OSATS) for surgical residentsBritish Journal of Surgery, 1997
- Generalizability theory.1992