Debriefing Assessment for Simulation in Healthcare
Authors:
- Marisa Brett-FleeglerMBMarisa Brett-Fleegler
- Jenny RudolphJRJenny Rudolph
- Walter EppichWEWalter Eppich
- Michael MonuteauxMMMichael Monuteaux
- Eric FleeglerEFEric Fleegler
- Adam ChengACAdam Cheng
- Robert SimonRSRobert Simon
- 1 October 2012
- journal article
- research article
- Published by Wolters Kluwer Health in Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
- Vol. 7 (5) , 288-294
Abstract
This study examined the reliability of the scores of an assessment instrument, the Debriefing Assessment for Simulation in Healthcare (DASH), in evaluating the quality of health care simulation debriefings. The secondary objective was to evaluate whether the instrument's scores demonstrate evidence of validity. Two aspects of reliability were examined, interrater reliability and internal consistency. To assess interrater reliability, intraclass correlations were calculated for 114 simulation instructors enrolled in webinar training courses in the use of the DASH. The instructors reviewed a series of 3 standardized debriefing sessions. To assess internal consistency, Cronbach α was calculated for this cohort. Finally, 1 measure of validity was examined by comparing the scores across 3 debriefings of different quality. Intraclass correlation coefficients for the individual elements were predominantly greater than 0.6. The overall intraclass correlation coefficient for the combined elements was 0.74. Cronbach α was 0.89 across the webinar raters. There were statistically significant differences among the ratings for the 3 standardized debriefings (P < 0.001). The DASH scores showed evidence of good reliability and preliminary evidence of validity. Additional work will be needed to assess the generalizability of the DASH based on the psychometrics of DASH data from other settings.Keywords
This publication has 44 references indexed in Scilit:
- Design and Evaluation of Simulation Scenarios for a Program Introducing Patient Safety, Teamwork, Safety Leadership, and Simulation to Healthcare Leaders and ManagersSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2011
- EXPRESS—Examining Pediatric Resuscitation Education Using Simulation and ScriptingSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2011
- Exploratory Randomized Controlled Trial of Hybrid Obstetric Simulation Training for Undergraduate StudentsSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2010
- Recognition and Treatment of Unstable Supraventricular Tachycardia by Pediatric Residents in a Simulation ScenarioSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2008
- Developing Theory Through Simulation MethodsAcademy of Management Review, 2007
- Trends and the future of postgraduate medical educationEmergency Medicine Journal, 2006
- Value of Debriefing during Simulated Crisis ManagementAnesthesiology, 2006
- Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic reviewMedical Teacher, 2005
- Psychological Safety and Learning Behavior in Work TeamsAdministrative Science Quarterly, 1999
- New issues in the use of behaviorally anchored rating scales: Level of analysis, the effects of incident frequency, and external validation.Journal of Applied Psychology, 1980