Measuring participants’ immersion in healthcare simulation: the development of an instrument
Open Access
- 1 January 2016
- journal article
- research article
- Published by Springer Nature in Advances in Simulation
- Vol. 1 (1) , 1-9
Abstract
Immersion is important for simulation-based education; however, questionnaire-based instruments to measure immersion have some limitations. The aim of the present work is to develop a new instrument to measure immersion among participants in healthcare simulation scenarios. The instrument was developed in four phases: trigger identification, content validity scores, inter-rater reliability analysis and comparison with an existing immersion measure instrument. A modified Delphi process was used to develop the instrument and to establish validity and reliability. The expert panel consisted of 10 researchers. All the researchers in the team had previous experience of simulation in the health and/or fire and rescue services as researchers and/or educators and simulation designers. To identify triggers, the panel members independently screened video recordings from simulation scenarios. Here, a trigger is an event in a simulation that is considered a sign of reduced or enhanced immersion among simulation participants. The result consists of the Immersion Score Rating Instrument (ISRI). It contains 10 triggers, of which seven indicate reduced and three enhanced immersion. When using ISRI, a rater identifies trigger occurrences and assigns them strength between 1 and 3. The content validity analysis shows that all the 10 triggers meet an acceptable content validity index for items (I-CVI) standard. The inter-rater reliability (IRR) among raters was assessed using a two-way mixed, consistency, average-measures intra-class correlation (ICC). The ICC for the difference between weighted positive and negative triggers was 0.92, which indicates that the raters are in agreement. Comparison with results from an immersion questionnaire mirrors the ISRI results. In conclusion, we present a novel and non-intrusive instrument for identifying and rating the level of immersion among participants in healthcare simulation scenarios.Keywords
This publication has 26 references indexed in Scilit:
- Immersive Interfaces for Engagement and LearningScience, 2009
- Measuring and defining the experience of immersion in gamesInternational Journal of Human-Computer Studies, 2008
- Exploring the potential of video technologies for collaboration in emergency medical care: Part II. Task performanceJournal of the American Society for Information Science and Technology, 2008
- Reality and Fiction Cues in Medical Patient Simulation: An Interview Study with AnesthesiologistsJournal of Cognitive Engineering and Decision Making, 2007
- Deepening the Theoretical Foundations of Patient Simulation as Social PracticeSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2007
- Which Reality Matters? Questions on the Path to High Engagement in Healthcare SimulationSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2007
- The content validity index: Are you sure you know what's being reported? critique and recommendationsResearch in Nursing & Health, 2006
- The future vision of simulation in health careQuality and Safety in Health Care, 2004
- Time Flies When You’re Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage1MIS Quarterly, 2000
- Measuring Presence in Virtual Environments: A Presence QuestionnairePRESENCE: Virtual and Augmented Reality, 1998