Tobias Mühling
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Tobias Mühling has a total of 45 co-authors. Here are the top co-authors by number of shared publications:
- Sarah König
Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany
11 shared publications Joy Backhaus
Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany
7 shared publications- Joy Backhaus
Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany
7 shared publications Sarah König
Office of the Dean of Studies, Faculty of Medicine, Julius-Maximilians-University Würzburg , Würzburg
6 shared publications- Tobias Leutritz
Institute for Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany
4 shared publications - Verena Schreiner
Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany
4 shared publications
Latest Publications
- Open Access
- 3 November 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Immersive virtual reality for assessing teamwork and clinical task performance: a multicenter pre-post study (Preprint)
BACKGROUND Immersive multi-user virtual reality (VR) offers standardized environments for interprofessional teamwork (IPT) training. However, evidence on observer-based assessment of teamwork performance in VR, its short-term maintenance, and its relationship with clinical task performance remains limited. OBJECTIVE To examine changes in observable IPT performance following structured teamwork instruction in immersive multi-user VR, its association with self-reported IPT perceptions, and the relationship between observed teamwork and clinical task performance across repeated sessions. METHODS In this multicenter pre-post study at four German academic institutions, 84 medical and nursing students completed three immersive VR emergency simulations in interprofessional dyads (days 1, 8, and 15), with a 30-minute TeamSTEPPS-based intervention before day 8. Blinded video ratings using the VR-adapted Team Performance Observation Tool (vTPOT) assessed observable teamwork. Self-reported perceptions were measured using the TeamSTEPPS Teamwork Perceptions Questionnaire (TPQ), and clinical task performance was captured through automated scenario-specific scores. Changes and associations were analyzed using mixed-effects models and correlation analyses, including a multiple-membership model accounting for changing dyads. RESULTS Of 126 scheduled dyadic sessions, 104 provided complete vTPOT and clinical performance data; 124 individual TPQ responses were available. Overall interrater reliability of the vTPOT was high (intraclass correlation coefficient 0.90). Adjusted vTPOT scores were higher than baseline immediately after the intervention (day 8: β=0.94, SE=0.14; P<.001) and at 1-week follow-up (day 15: β=0.75, SE=0.14; P<.001), with increases across all five domains. Self-reported IPT perceptions were also higher at follow-up (β=0.39, SE=0.13; P=.003). The association between dyad-averaged TPQ and vTPOT scores was weak at baseline (r=0.15, 95% CI −0.21 to 0.46) but improving at follow-up (r=0.49, 95% CI 0.11 to 0.74). Mean clinical task performance increased descriptively from 32.7% at baseline to 42.0% after the intervention and 50.8% at follow-up. In the multiple-membership model, higher vTPOT scores were associated with higher clinical task performance (β=11.18 percentage points per vTPOT point, 95% CI 5.18 to 16.81; P=.001). Communication, leadership, and situation monitoring showed the most consistent domain-specific associations with clinical task performance. CONCLUSIONS Immersive multi-user VR provided a standardized environment in which observable interprofessional teamwork and clinical task performance could be assessed together across multiple institutions and clinical scenarios. Observer-rated teamwork captured information not fully reflected in participants’ self-reported perceptions and was associated with clinical task performance. Further controlled studies should examine the specific contribution of VR-based approaches and the durability and transfer of observed performance changes.
- 3 November 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessImmersive virtual reality for assessing teamwork and clinical task performance: a multicenter pre-post study (Preprint)
BACKGROUND Immersive multi-user virtual reality (VR) offers standardized environments for interprofessional teamwork (IPT) training. However, evidence on observer-based assessment of teamwork performance in VR, its short-term maintenance, and its relationship with clinical task performance remains limited. OBJECTIVE To examine changes in observable IPT performance following structured teamwork instruction in immersive multi-user VR, its association with self-reported IPT perceptions, and the relationship between observed teamwork and clinical task performance across repeated sessions. METHODS In this multicenter pre-post study at four German academic institutions, 84 medical and nursing students completed three immersive VR emergency simulations in interprofessional dyads (days 1, 8, and 15), with a 30-minute TeamSTEPPS-based intervention before day 8. Blinded video ratings using the VR-adapted Team Performance Observation Tool (vTPOT) assessed observable teamwork. Self-reported perceptions were measured using the TeamSTEPPS Teamwork Perceptions Questionnaire (TPQ), and clinical task performance was captured through automated scenario-specific scores. Changes and associations were analyzed using mixed-effects models and correlation analyses, including a multiple-membership model accounting for changing dyads. RESULTS Of 126 scheduled dyadic sessions, 104 provided complete vTPOT and clinical performance data; 124 individual TPQ responses were available. Overall interrater reliability of the vTPOT was high (intraclass correlation coefficient 0.90). Adjusted vTPOT scores were higher than baseline immediately after the intervention (day 8: β=0.94, SE=0.14; P<.001) and at 1-week follow-up (day 15: β=0.75, SE=0.14; P<.001), with increases across all five domains. Self-reported IPT perceptions were also higher at follow-up (β=0.39, SE=0.13; P=.003). The association between dyad-averaged TPQ and vTPOT scores was weak at baseline (r=0.15, 95% CI −0.21 to 0.46) but improving at follow-up (r=0.49, 95% CI 0.11 to 0.74). Mean clinical task performance increased descriptively from 32.7% at baseline to 42.0% after the intervention and 50.8% at follow-up. In the multiple-membership model, higher vTPOT scores were associated with higher clinical task performance (β=11.18 percentage points per vTPOT point, 95% CI 5.18 to 16.81; P=.001). Communication, leadership, and situation monitoring showed the most consistent domain-specific associations with clinical task performance. CONCLUSIONS Immersive multi-user VR provided a standardized environment in which observable interprofessional teamwork and clinical task performance could be assessed together across multiple institutions and clinical scenarios. Observer-rated teamwork captured information not fully reflected in participants’ self-reported perceptions and was associated with clinical task performance. Further controlled studies should examine the specific contribution of VR-based approaches and the durability and transfer of observed performance changes.
- Open Access
- 5 June 2026
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 101 (9) , 1056-1057
Before we trust the scores: rethinking virtual reality in medical assessment
- 5 June 2026
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 101 (9) , 1056-1057
Open AccessBefore we trust the scores: rethinking virtual reality in medical assessment
- Open Access
- 1 June 2026
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 13
Students’ Experiences of Presence and Learning Across Simulated and Virtual Patient Formats: A Cross-Sectional Study
Purpose: While traditional medical education emphasizes real patient interactions, practical and ethical constraints require alternatives, such as simulated patients (SPs) or virtual patients (VPs) in virtual reality. This study investigates medical students’ experiential perceptions across different simulation formats within the same undergraduate medical curriculum, using a newly developed modality-spanning questionnaire. Methods: A prospective cross-sectional study was conducted with 486 medical students across four curricular courses with differing educational content and objectives (two SP-based and two VP-based courses). A study-specific questionnaire applicable across both simulation formats captured “experience of presence” (‘embodiment’, ‘involvement’, ‘coherence’) and “experience of learning” (‘experience of competence’, ‘tension’, ‘acquisition of skills’, ‘enthusiasm’). Exploratory and confirmatory factor analyses were used to examine internal structure and psychometric properties of the questionnaire. Results: Analyses indicated a stable internal structure with good sampling adequacy (Cronbach’s α = 0.82 for “experience of presence” and α = 0.66 for “experience of learning”). While overall perceived learning did not differ between simulation formats, format-specific experiential profiles emerged. SPs were rated higher for “experience of presence”, particularly regarding ‘involvement’ (M = 4.05 vs. 2.62), whereas VPs scored higher for ‘coherence’ (M = 4.50 vs. 3.98). Within learning-related dimensions, SPs were associated with greater ‘tension’ (M = 3.57 vs. 2.71) and ‘acquisition of skills’ (M = 4.66 vs. 4.24), while VPs elicited higher levels of ‘enthusiasm’ (M = 4.57 vs. 4.03; all p < 0.001). Conclusion: This study provides insights into how medical students experience presence and learning across different simulation formats within an authentic curricular setting. While SPs appear to foster emotional engagement and perceived skill acquisition, VPs may particularly support spatial orientation and motivational aspects. Applying a single questionnaire across content-diverse courses and modalities may support educators in strategically aligning simulation formats with specific educational objectives and guiding the targeted development of curricula.
- 1 June 2026
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 13
Open AccessStudents’ Experiences of Presence and Learning Across Simulated and Virtual Patient Formats: A Cross-Sectional Study
Purpose: While traditional medical education emphasizes real patient interactions, practical and ethical constraints require alternatives, such as simulated patients (SPs) or virtual patients (VPs) in virtual reality. This study investigates medical students’ experiential perceptions across different simulation formats within the same undergraduate medical curriculum, using a newly developed modality-spanning questionnaire. Methods: A prospective cross-sectional study was conducted with 486 medical students across four curricular courses with differing educational content and objectives (two SP-based and two VP-based courses). A study-specific questionnaire applicable across both simulation formats captured “experience of presence” (‘embodiment’, ‘involvement’, ‘coherence’) and “experience of learning” (‘experience of competence’, ‘tension’, ‘acquisition of skills’, ‘enthusiasm’). Exploratory and confirmatory factor analyses were used to examine internal structure and psychometric properties of the questionnaire. Results: Analyses indicated a stable internal structure with good sampling adequacy (Cronbach’s α = 0.82 for “experience of presence” and α = 0.66 for “experience of learning”). While overall perceived learning did not differ between simulation formats, format-specific experiential profiles emerged. SPs were rated higher for “experience of presence”, particularly regarding ‘involvement’ (M = 4.05 vs. 2.62), whereas VPs scored higher for ‘coherence’ (M = 4.50 vs. 3.98). Within learning-related dimensions, SPs were associated with greater ‘tension’ (M = 3.57 vs. 2.71) and ‘acquisition of skills’ (M = 4.66 vs. 4.24), while VPs elicited higher levels of ‘enthusiasm’ (M = 4.57 vs. 4.03; all p < 0.001). Conclusion: This study provides insights into how medical students experience presence and learning across different simulation formats within an authentic curricular setting. While SPs appear to foster emotional engagement and perceived skill acquisition, VPs may particularly support spatial orientation and motivational aspects. Applying a single questionnaire across content-diverse courses and modalities may support educators in strategically aligning simulation formats with specific educational objectives and guiding the targeted development of curricula.
- Open Access
- 8 April 2026
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 12, e82136
Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study
Background: Virtual reality (VR) is increasingly used in medical education for training and examination purposes; yet, learners’ performance in VR-based assessments may be influenced by more than clinical competence alone. Immersive competence (IC) has been proposed as a relevant factor in VR-based performance assessment. While general IC captures application-independent VR interaction skills, domain-specific applications may require an additional construct, specific immersive competence (specific IC), reflecting context-dependent interaction proficiency. Objective: This study aimed to develop and examine the initial psychometric characteristics of a newly developed in situ checklist for assessing specific IC, to explore the relationship between specific and general IC as well as related human abilities and characteristics, and to capture preliminary associations between both IC measures and medical performance in a VR-based objective structured clinical examination (OSCE) station. Methods: In this observational follow-up study, 21 final-year medical students who had previously completed a curricular OSCE including a VR-based emergency medicine station were recruited. General IC was assessed using the VR competence app, and specific IC using a checklist embedded in the original VR simulation. Additional measures included self-reported technological affinity, spatial ability, and OSCE performance scores. Analyses focused on descriptive statistics and exploratory associations, including item difficulty, item-total correlations, and internal consistency for the specific IC checklist. Pearson r was used to examine associations among variables. Results: The final 13-item specific IC checklist demonstrated acceptable internal consistency for an early-stage instrument (Cronbach α=0.79) and balanced item difficulty (mean P 0.56, SD 0.28). Specific IC showed a strong exploratory association with general IC (r=0.56; P=.008) and with prior 3D application experience (r=0.57; P=.007), but no relevant association with spatial ability. Both general and specific IC showed borderline, moderate associations with VR-OSCE performance (r=0.41; P=.06 and r=0.37; P=.09, respectively), while neither was related to overall analog OSCE performance. Conclusions: In this pilot sample, specific IC emerged as a psychometrically accessible construct aimed to capture context-sensitive VR interaction skills. The proposed in situ approach offers a feasible and scalable method to assess this construct within domain-specific VR applications. Although associations with medical performance were exploratory and limited by sample size, the findings suggest the relevance of IC as a potential source of construct-irrelevant variance in VR-based assessments and support further investigation in larger, confirmatory studies.
- 8 April 2026
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 12, e82136
Open AccessDevelopment and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study
Background: Virtual reality (VR) is increasingly used in medical education for training and examination purposes; yet, learners’ performance in VR-based assessments may be influenced by more than clinical competence alone. Immersive competence (IC) has been proposed as a relevant factor in VR-based performance assessment. While general IC captures application-independent VR interaction skills, domain-specific applications may require an additional construct, specific immersive competence (specific IC), reflecting context-dependent interaction proficiency. Objective: This study aimed to develop and examine the initial psychometric characteristics of a newly developed in situ checklist for assessing specific IC, to explore the relationship between specific and general IC as well as related human abilities and characteristics, and to capture preliminary associations between both IC measures and medical performance in a VR-based objective structured clinical examination (OSCE) station. Methods: In this observational follow-up study, 21 final-year medical students who had previously completed a curricular OSCE including a VR-based emergency medicine station were recruited. General IC was assessed using the VR competence app, and specific IC using a checklist embedded in the original VR simulation. Additional measures included self-reported technological affinity, spatial ability, and OSCE performance scores. Analyses focused on descriptive statistics and exploratory associations, including item difficulty, item-total correlations, and internal consistency for the specific IC checklist. Pearson r was used to examine associations among variables. Results: The final 13-item specific IC checklist demonstrated acceptable internal consistency for an early-stage instrument (Cronbach α=0.79) and balanced item difficulty (mean P 0.56, SD 0.28). Specific IC showed a strong exploratory association with general IC (r=0.56; P=.008) and with prior 3D application experience (r=0.57; P=.007), but no relevant association with spatial ability. Both general and specific IC showed borderline, moderate associations with VR-OSCE performance (r=0.41; P=.06 and r=0.37; P=.09, respectively), while neither was related to overall analog OSCE performance. Conclusions: In this pilot sample, specific IC emerged as a psychometrically accessible construct aimed to capture context-sensitive VR interaction skills. The proposed in situ approach offers a feasible and scalable method to assess this construct within domain-specific VR applications. Although associations with medical performance were exploratory and limited by sample size, the findings suggest the relevance of IC as a potential source of construct-irrelevant variance in VR-based assessments and support further investigation in larger, confirmatory studies.
- Open Access
- 12 March 2026
- Published by Springer Nature in Advances in Simulation
- Vol. 11 (1)
Adapting the TeamSTEPPS team performance observation tool for dyadic interprofessional VR simulations (vTPOT): a multi-step validation study
Background: Interprofessional teamwork is a key determinant of patient safety in medical emergencies, yet its structured assessment remains resource-intensive and is rarely integrated into undergraduate curricula. Immersive virtual reality (VR) offers scalable environments for training and assessing teamwork but introduces contextual constraints such as dyadic team structures, avatar-mediated interaction, and limited non-verbal cues. Established assessment tools, including the Team Performance Observation Tool (TPOT), have not been systematically adapted or validated for these VR-specific conditions. Methods: We adapted the TPOT for dyadic VR-based emergency simulations (vTPOT) through expert-driven item revision, development of behavioral anchors, and a two-round modified Delphi process with 15 interprofessional experts. No new VR-specific items were introduced, instead, items that could not be meaningfully observed in immersive VR were removed or consolidated to preserve conceptual stability. Five trained raters independently evaluated 21 VR simulation videos from interprofessional dyads (medical and nursing students) using both the original TPOT and the vTPOT. Following Kane’s argument-based validation framework, we examined evidence for scoring (content validity, association with the original TPOT), generalization (internal consistency, interrater reliability), extrapolation (associations with teamwork perceptions and objective medical performance), and implications (written qualitative responses from raters) on potential unintended effects and implications for feedback and assessment). Results: The final vTPOT comprises 15 behaviorally anchored items across five teamwork domains. Internal consistency was high (Cronbach’s α = 0.92), and interrater reliability was moderate to substantial (intraclass correlation coefficient = 0.68). vTPOT scores showed strong convergence with the original TPOT ( r = 0.92) and with participants’ teamwork perceptions (T-TPQ; ρ = 0.64 and 0.80 for nursing and medical students, respectively). Higher vTPOT scores were positively associated with objectively measured medical performance in VR scenarios ( r = 0.54). Raters reported that the vTPOT supported structured observation and feedback, while also highlighting context-specific limitations and potential unintended effects. Conclusions: The vTPOT appears to be a feasible and reliable instrument for assessing interprofessional teamwork in dyadic VR simulations within the studied context. Initial validity evidence supports its intended use for low-stakes assessment and research. Further studies are needed to examine construct structure and extend validation to additional contexts, populations, and outcomes to strengthen the overall validity argument.
- 12 March 2026
- Published by Springer Nature in Advances in Simulation
- Vol. 11 (1)
Open AccessAdapting the TeamSTEPPS team performance observation tool for dyadic interprofessional VR simulations (vTPOT): a multi-step validation study
Background: Interprofessional teamwork is a key determinant of patient safety in medical emergencies, yet its structured assessment remains resource-intensive and is rarely integrated into undergraduate curricula. Immersive virtual reality (VR) offers scalable environments for training and assessing teamwork but introduces contextual constraints such as dyadic team structures, avatar-mediated interaction, and limited non-verbal cues. Established assessment tools, including the Team Performance Observation Tool (TPOT), have not been systematically adapted or validated for these VR-specific conditions. Methods: We adapted the TPOT for dyadic VR-based emergency simulations (vTPOT) through expert-driven item revision, development of behavioral anchors, and a two-round modified Delphi process with 15 interprofessional experts. No new VR-specific items were introduced, instead, items that could not be meaningfully observed in immersive VR were removed or consolidated to preserve conceptual stability. Five trained raters independently evaluated 21 VR simulation videos from interprofessional dyads (medical and nursing students) using both the original TPOT and the vTPOT. Following Kane’s argument-based validation framework, we examined evidence for scoring (content validity, association with the original TPOT), generalization (internal consistency, interrater reliability), extrapolation (associations with teamwork perceptions and objective medical performance), and implications (written qualitative responses from raters) on potential unintended effects and implications for feedback and assessment). Results: The final vTPOT comprises 15 behaviorally anchored items across five teamwork domains. Internal consistency was high (Cronbach’s α = 0.92), and interrater reliability was moderate to substantial (intraclass correlation coefficient = 0.68). vTPOT scores showed strong convergence with the original TPOT ( r = 0.92) and with participants’ teamwork perceptions (T-TPQ; ρ = 0.64 and 0.80 for nursing and medical students, respectively). Higher vTPOT scores were positively associated with objectively measured medical performance in VR scenarios ( r = 0.54). Raters reported that the vTPOT supported structured observation and feedback, while also highlighting context-specific limitations and potential unintended effects. Conclusions: The vTPOT appears to be a feasible and reliable instrument for assessing interprofessional teamwork in dyadic VR simulations within the studied context. Initial validity evidence supports its intended use for low-stakes assessment and research. Further studies are needed to examine construct structure and extend validation to additional contexts, populations, and outcomes to strengthen the overall validity argument.
- Open Access
- 9 March 2026
- Published by Springer Nature in npj Digital Medicine
- Vol. 9 (1)
Immersive competence as a source of bias in virtual reality clinical assessment
Virtual reality (VR) is increasingly used for assessment in educational and clinical settings. However, users’ immersive competence (IC)—the ability to navigate and operate VR systems—may introduce bias unrelated to clinical skills or patient functioning. In this randomized controlled trial, 88 medical students received either general IC training, general+specific IC training, or no structured training before completing a VR-based assessment scenario. Multimodal data were collected, including electrodermal activity, cognitive-load ratings, procedural efficiency, and usability barriers. Specific IC training improved performance compared with control (28.3% ± 10.3% vs. 21.2% ± 10.8%, p = 0.010, d = 0.67), moderated by procedural efficiency and increased cognitive load. Prior 3D experience did not predict performance in the control group, likely due to a floor effect, but did in the specific training group. These findings indicate that IC is a causal, modifiable factor in VR-based assessments and should be considered to ensure fair and valid evaluations.
- 9 March 2026
- Published by Springer Nature in npj Digital Medicine
- Vol. 9 (1)
Open AccessImmersive competence as a source of bias in virtual reality clinical assessment
Virtual reality (VR) is increasingly used for assessment in educational and clinical settings. However, users’ immersive competence (IC)—the ability to navigate and operate VR systems—may introduce bias unrelated to clinical skills or patient functioning. In this randomized controlled trial, 88 medical students received either general IC training, general+specific IC training, or no structured training before completing a VR-based assessment scenario. Multimodal data were collected, including electrodermal activity, cognitive-load ratings, procedural efficiency, and usability barriers. Specific IC training improved performance compared with control (28.3% ± 10.3% vs. 21.2% ± 10.8%, p = 0.010, d = 0.67), moderated by procedural efficiency and increased cognitive load. Prior 3D experience did not predict performance in the control group, likely due to a floor effect, but did in the specific training group. These findings indicate that IC is a causal, modifiable factor in VR-based assessments and should be considered to ensure fair and valid evaluations.
- Open Access
- 20 November 2025
- Published by Springer Nature in Virtual Reality
- Vol. 29 (4) , 175
Enhancing pediatric emergency training: the impact of virtual reality-simulation on medical student knowledge and learning experience—a pre-post intervention study
Pediatric emergencies present significant risks, and medical students often have limited exposure to these situations, hindering the development of clinical skills. Virtual reality (VR) simulation offer a solution by providing high-fidelity experiences for practicing clinical reasoning and procedures. This study aimed to assess knowledge gain and gather student perspectives following a seminar based on a pediatric emergency VR simulation. A 45-min VR case scenario involving a newborn with late-onset sepsis was developed and implemented as part of a seminar during their pediatric clinical rotation for medical students. The learning experience in the seminar was further enhanced by feedback from peers and an expert clinician. Students’ knowledge was assessed before and after the seminar using open-ended questions. Additionally, a post-seminar questionnaire was employed to gather feedback on estimated learning success in individual clinical competencies, the effectiveness of VR simulation as a learning tool, and the didactic concept. Of the 116 students who attended the seminar, pre- and post-tests assessing objective knowledge were completed by 109. Average knowledge scores increased from 7.80 ± 2.1 points before the seminar to 10.90 ± 1.2 points after (out of a maximum of 12 points) ( p < .001). Knowledge of 5 out of 6 individual diagnostic and therapeutic measures showed a significant increase. Regarding learning success, participants reported a significantly increased competence level in all four assessed categories (on average from 2.68 ± 1.07 to 4.15 ± 0.70 on a 5-point Likert scale, p < .001). The VR software used for learning the pediatric emergency and its integration into the didactic concept of the seminar were also positively evaluated retrospectively. VR simulations for pediatric emergencies offer a practical means for students to link theoretical knowledge with practical skills. They prove to be a motivating educational tool that leads to an enhancement in students’ knowledge. In addition to its positive impact on learning outcomes, the present study also illustrates another potential approach for integrating VR simulation into a curricular seminar format.
- 20 November 2025
- Published by Springer Nature in Virtual Reality
- Vol. 29 (4) , 175
Open AccessEnhancing pediatric emergency training: the impact of virtual reality-simulation on medical student knowledge and learning experience—a pre-post intervention study
Pediatric emergencies present significant risks, and medical students often have limited exposure to these situations, hindering the development of clinical skills. Virtual reality (VR) simulation offer a solution by providing high-fidelity experiences for practicing clinical reasoning and procedures. This study aimed to assess knowledge gain and gather student perspectives following a seminar based on a pediatric emergency VR simulation. A 45-min VR case scenario involving a newborn with late-onset sepsis was developed and implemented as part of a seminar during their pediatric clinical rotation for medical students. The learning experience in the seminar was further enhanced by feedback from peers and an expert clinician. Students’ knowledge was assessed before and after the seminar using open-ended questions. Additionally, a post-seminar questionnaire was employed to gather feedback on estimated learning success in individual clinical competencies, the effectiveness of VR simulation as a learning tool, and the didactic concept. Of the 116 students who attended the seminar, pre- and post-tests assessing objective knowledge were completed by 109. Average knowledge scores increased from 7.80 ± 2.1 points before the seminar to 10.90 ± 1.2 points after (out of a maximum of 12 points) ( p < .001). Knowledge of 5 out of 6 individual diagnostic and therapeutic measures showed a significant increase. Regarding learning success, participants reported a significantly increased competence level in all four assessed categories (on average from 2.68 ± 1.07 to 4.15 ± 0.70 on a 5-point Likert scale, p < .001). The VR software used for learning the pediatric emergency and its integration into the didactic concept of the seminar were also positively evaluated retrospectively. VR simulations for pediatric emergencies offer a practical means for students to link theoretical knowledge with practical skills. They prove to be a motivating educational tool that leads to an enhancement in students’ knowledge. In addition to its positive impact on learning outcomes, the present study also illustrates another potential approach for integrating VR simulation into a curricular seminar format.
- Open Access
- 10 August 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study (Preprint)
BACKGROUND Virtual reality (VR) is increasingly used in medical education for training and examination purposes; yet, learners’ performance in VR-based assessments may be influenced by more than clinical competence alone. Immersive competence (IC) has been proposed as a relevant factor in VR-based performance assessment. While general IC captures application-independent VR interaction skills, domain-specific applications may require an additional construct, specific immersive competence (specific IC), reflecting context-dependent interaction proficiency. OBJECTIVE This study aimed to develop and examine the initial psychometric characteristics of a newly developed in situ checklist for assessing specific IC, to explore the relationship between specific and general IC as well as related human abilities and characteristics, and to capture preliminary associations between both IC measures and medical performance in a VR-based objective structured clinical examination (OSCE) station. METHODS In this observational follow-up study, 21 final-year medical students who had previously completed a curricular OSCE including a VR-based emergency medicine station were recruited. General IC was assessed using the VR competence app, and specific IC using a checklist embedded in the original VR simulation. Additional measures included self-reported technological affinity, spatial ability, and OSCE performance scores. Analyses focused on descriptive statistics and exploratory associations, including item difficulty, item-total correlations, and internal consistency for the specific IC checklist. Pearson r was used to examine associations among variables. RESULTS The final 13-item specific IC checklist demonstrated acceptable internal consistency for an early-stage instrument (Cronbach α=0.79) and balanced item difficulty (mean P 0.56, SD 0.28). Specific IC showed a strong exploratory association with general IC (r=0.56; P=.008) and with prior 3D application experience (r=0.57; P=.007), but no relevant association with spatial ability. Both general and specific IC showed borderline, moderate associations with VR-OSCE performance (r=0.41; P=.06 and r=0.37; P=.09, respectively), while neither was related to overall analog OSCE performance. CONCLUSIONS In this pilot sample, specific IC emerged as a psychometrically accessible construct aimed to capture context-sensitive VR interaction skills. The proposed in situ approach offers a feasible and scalable method to assess this construct within domain-specific VR applications. Although associations with medical performance were exploratory and limited by sample size, the findings suggest the relevance of IC as a potential source of construct-irrelevant variance in VR-based assessments and support further investigation in larger, confirmatory studies.
- 10 August 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDevelopment and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study (Preprint)
BACKGROUND Virtual reality (VR) is increasingly used in medical education for training and examination purposes; yet, learners’ performance in VR-based assessments may be influenced by more than clinical competence alone. Immersive competence (IC) has been proposed as a relevant factor in VR-based performance assessment. While general IC captures application-independent VR interaction skills, domain-specific applications may require an additional construct, specific immersive competence (specific IC), reflecting context-dependent interaction proficiency. OBJECTIVE This study aimed to develop and examine the initial psychometric characteristics of a newly developed in situ checklist for assessing specific IC, to explore the relationship between specific and general IC as well as related human abilities and characteristics, and to capture preliminary associations between both IC measures and medical performance in a VR-based objective structured clinical examination (OSCE) station. METHODS In this observational follow-up study, 21 final-year medical students who had previously completed a curricular OSCE including a VR-based emergency medicine station were recruited. General IC was assessed using the VR competence app, and specific IC using a checklist embedded in the original VR simulation. Additional measures included self-reported technological affinity, spatial ability, and OSCE performance scores. Analyses focused on descriptive statistics and exploratory associations, including item difficulty, item-total correlations, and internal consistency for the specific IC checklist. Pearson r was used to examine associations among variables. RESULTS The final 13-item specific IC checklist demonstrated acceptable internal consistency for an early-stage instrument (Cronbach α=0.79) and balanced item difficulty (mean P 0.56, SD 0.28). Specific IC showed a strong exploratory association with general IC (r=0.56; P=.008) and with prior 3D application experience (r=0.57; P=.007), but no relevant association with spatial ability. Both general and specific IC showed borderline, moderate associations with VR-OSCE performance (r=0.41; P=.06 and r=0.37; P=.09, respectively), while neither was related to overall analog OSCE performance. CONCLUSIONS In this pilot sample, specific IC emerged as a psychometrically accessible construct aimed to capture context-sensitive VR interaction skills. The proposed in situ approach offers a feasible and scalable method to assess this construct within domain-specific VR applications. Although associations with medical performance were exploratory and limited by sample size, the findings suggest the relevance of IC as a potential source of construct-irrelevant variance in VR-based assessments and support further investigation in larger, confirmatory studies.
- Open Access
- 4 June 2025
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 27 (1) , e67412
Knowledge Gain and the Impact of Stress in a Fully Immersive Virtual Reality–Based Medical Emergencies Training With Automated Feedback: Randomized Controlled Trial
Background: A significant gap exists in the knowledge and procedural skills of medical graduates when it comes to managing emergencies. In response, highly immersive virtual reality (VR)–based learning environments have been developed to train clinical competencies. However, robust evidence on how VR-based methods affect both short- and long-term learning outcomes, as well as physiological and perceived stress, remains limited. Objective: This study aimed to assess the effectiveness of VR-based simulation training, augmented with automated feedback, compared with video seminars at improving emergency medical competency among medical students. Furthermore, the study investigated the relationship between learning outcomes and physiological stress markers. The evaluation of participants’ perceived stress and estimated learning success was also performed to provide a more comprehensive insight into VR’s potential role in emergency training. Methods: In total, 72 senior medical students underwent VR-based emergency training (intervention) or viewed video seminars (control) on 2 topics (acute myocardial infarction and exacerbated chronic obstructive pulmonary disease) in an intraindividual crossover design. Levels of applied knowledge were assessed objectively by open-response tests pre- and postintervention and after 30 days. In addition, 2 electrodermal activity markers representing physiological stress response were measured during VR sessions using a wearable sensor. Participants also rated their estimated learning success and perceived stress. They also completed self-ratings of perceived stress and estimated learning success. Results: Short-term knowledge gains were comparable between the VR (mean 26.6%, SD 15.3%) and control (mean 27.2%, SD 16%) condition. However, VR training produced significantly higher long-term knowledge gains (VR: mean 17.8%, SD 15.1% vs control: mean 11.9%, SD 18%; difference: –5.9, 95% CI –11.5 to –0.4). Overall retention scores were likewise higher for VR (mean 75.4%, SD 12.5%) than for video-based learning (mean 69.0%, SD 14.5%), a difference that was more pronounced in the myocardial infarction scenario. Participants rated the VR format as significantly more effective (mean 4.83, SD 0.41, on a 5-point scale) than the video seminar (mean 3.44, SD 1.00). While physiological stress markers increased during VR sessions, their correlation with knowledge gains was weak and negative. No significant relationship was detectable between perceived stress and objective learning outcomes. Conclusion: VR-based simulation training with automated feedback may offer long-term learning advantages over a traditional video seminar in emergency-medicine education. Given the time constraints and resource limitations of clinical education, self-moderated VR-based learning may represent a valuable addition to conventional training methods. Future research could investigate the learning effects of VR scenarios regarding the retention of practical skills, as well as the impact of repeated or team-based scenarios.
- 4 June 2025
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 27 (1) , e67412
Open AccessKnowledge Gain and the Impact of Stress in a Fully Immersive Virtual Reality–Based Medical Emergencies Training With Automated Feedback: Randomized Controlled Trial
Background: A significant gap exists in the knowledge and procedural skills of medical graduates when it comes to managing emergencies. In response, highly immersive virtual reality (VR)–based learning environments have been developed to train clinical competencies. However, robust evidence on how VR-based methods affect both short- and long-term learning outcomes, as well as physiological and perceived stress, remains limited. Objective: This study aimed to assess the effectiveness of VR-based simulation training, augmented with automated feedback, compared with video seminars at improving emergency medical competency among medical students. Furthermore, the study investigated the relationship between learning outcomes and physiological stress markers. The evaluation of participants’ perceived stress and estimated learning success was also performed to provide a more comprehensive insight into VR’s potential role in emergency training. Methods: In total, 72 senior medical students underwent VR-based emergency training (intervention) or viewed video seminars (control) on 2 topics (acute myocardial infarction and exacerbated chronic obstructive pulmonary disease) in an intraindividual crossover design. Levels of applied knowledge were assessed objectively by open-response tests pre- and postintervention and after 30 days. In addition, 2 electrodermal activity markers representing physiological stress response were measured during VR sessions using a wearable sensor. Participants also rated their estimated learning success and perceived stress. They also completed self-ratings of perceived stress and estimated learning success. Results: Short-term knowledge gains were comparable between the VR (mean 26.6%, SD 15.3%) and control (mean 27.2%, SD 16%) condition. However, VR training produced significantly higher long-term knowledge gains (VR: mean 17.8%, SD 15.1% vs control: mean 11.9%, SD 18%; difference: –5.9, 95% CI –11.5 to –0.4). Overall retention scores were likewise higher for VR (mean 75.4%, SD 12.5%) than for video-based learning (mean 69.0%, SD 14.5%), a difference that was more pronounced in the myocardial infarction scenario. Participants rated the VR format as significantly more effective (mean 4.83, SD 0.41, on a 5-point scale) than the video seminar (mean 3.44, SD 1.00). While physiological stress markers increased during VR sessions, their correlation with knowledge gains was weak and negative. No significant relationship was detectable between perceived stress and objective learning outcomes. Conclusion: VR-based simulation training with automated feedback may offer long-term learning advantages over a traditional video seminar in emergency-medicine education. Given the time constraints and resource limitations of clinical education, self-moderated VR-based learning may represent a valuable addition to conventional training methods. Future research could investigate the learning effects of VR scenarios regarding the retention of practical skills, as well as the impact of repeated or team-based scenarios.
- Open Access
- 27 May 2025
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 14, e68705
Training and Assessing Teamwork in Interprofessional Virtual Reality–Based Simulation Using the TeamSTEPPS Framework: Protocol for Randomized Pre-Post Intervention Study
Background: Interprofessional teamwork is essential for patient outcomes in emergency medicine; yet, effective training in this area is scarce. Virtual reality (VR) provides a promising, resource-efficient solution for simulating emergency scenarios and facilitating interprofessional collaboration. While VR-based training has shown benefits for medical skill and knowledge acquisition, assessing teamwork within such environments remains a challenge due to the lack of validated measurement tools. Existing teamwork assessment instruments, developed for physical simulations, may not fully apply to VR due to differences in communication modalities, interaction mechanics, and observer perspectives. Objective: This study aims to adapt and validate the TeamSTEPPS framework to assess teamwork in VR-based training. Subsequently, these adapted instruments will enable the investigation of whether interprofessional teamwork can be successfully trained in VR scenarios. Methods: Prior to the study, measurement instruments for subjective (Teamwork Perceptions Questionnaire) and objective teamwork quality (Team Performance Observation Tool, TPOT) will be adapted and validated for use in VR scenarios. Validation of the adapted version of the Team Performance Observation Tool includes expert consensus via a modified Delphi method as well as validity and reliability testing using recorded VR teamwork sessions. The study itself is designed as a prospective pre-post study with a planned enrollment of 65 nursing and 65 medical students working in randomly assigned interprofessional teams. On 3 timepoints (day 1, day 8, and day 15), participants engage in a VR scenario simulating 1 out of 3 different emergency medical conditions (esophageal variceal bleeding, exacerbated chronic obstructive pulmonary disease, and atrial fibrillation due to urinary tract infection). As an intervention, a structured training video on successful teamwork according to the TeamSTEPPS concept is shown on day 8 immediately before the second VR scenario. Teamwork is assessed objectively with the adapted version of the Team Performance Observation Tool and subjectively with the adapted Teamwork Perceptions Questionnaire. Medical performance will be recorded automatically by the VR software based on the medical measures conducted by the team. Results: As of May 2024, a total of 28 interprofessional teams have been enrolled. Data analysis will begin in late 2025. Conclusions: This study addresses the challenge of adapting teamwork assessment tools to VR environments and may provide insights into the potential of VR-based training for improving interprofessional collaboration in medical education. Future research could include a control group to measure the effects of team training more rigorously or use more enhanced technologies (eg, natural language processing) to capture the full range of teamwork behavior. International Registered Report Identifier (IRRID): DERR1-10.2196/68705
- 27 May 2025
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 14, e68705
Open AccessTraining and Assessing Teamwork in Interprofessional Virtual Reality–Based Simulation Using the TeamSTEPPS Framework: Protocol for Randomized Pre-Post Intervention Study
Background: Interprofessional teamwork is essential for patient outcomes in emergency medicine; yet, effective training in this area is scarce. Virtual reality (VR) provides a promising, resource-efficient solution for simulating emergency scenarios and facilitating interprofessional collaboration. While VR-based training has shown benefits for medical skill and knowledge acquisition, assessing teamwork within such environments remains a challenge due to the lack of validated measurement tools. Existing teamwork assessment instruments, developed for physical simulations, may not fully apply to VR due to differences in communication modalities, interaction mechanics, and observer perspectives. Objective: This study aims to adapt and validate the TeamSTEPPS framework to assess teamwork in VR-based training. Subsequently, these adapted instruments will enable the investigation of whether interprofessional teamwork can be successfully trained in VR scenarios. Methods: Prior to the study, measurement instruments for subjective (Teamwork Perceptions Questionnaire) and objective teamwork quality (Team Performance Observation Tool, TPOT) will be adapted and validated for use in VR scenarios. Validation of the adapted version of the Team Performance Observation Tool includes expert consensus via a modified Delphi method as well as validity and reliability testing using recorded VR teamwork sessions. The study itself is designed as a prospective pre-post study with a planned enrollment of 65 nursing and 65 medical students working in randomly assigned interprofessional teams. On 3 timepoints (day 1, day 8, and day 15), participants engage in a VR scenario simulating 1 out of 3 different emergency medical conditions (esophageal variceal bleeding, exacerbated chronic obstructive pulmonary disease, and atrial fibrillation due to urinary tract infection). As an intervention, a structured training video on successful teamwork according to the TeamSTEPPS concept is shown on day 8 immediately before the second VR scenario. Teamwork is assessed objectively with the adapted version of the Team Performance Observation Tool and subjectively with the adapted Teamwork Perceptions Questionnaire. Medical performance will be recorded automatically by the VR software based on the medical measures conducted by the team. Results: As of May 2024, a total of 28 interprofessional teams have been enrolled. Data analysis will begin in late 2025. Conclusions: This study addresses the challenge of adapting teamwork assessment tools to VR environments and may provide insights into the potential of VR-based training for improving interprofessional collaboration in medical education. Future research could include a control group to measure the effects of team training more rigorously or use more enhanced technologies (eg, natural language processing) to capture the full range of teamwork behavior. International Registered Report Identifier (IRRID): DERR1-10.2196/68705