Jakob Carl Uhl
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jakob Carl Uhl has a total of 51 co-authors. Here are the top co-authors by number of shared publications:
- Manfred Tscheligi
AIT Austrian Institute of Technology
15 shared publications - Georg Regal
AIT Austrian Institute of Technology, Vienna, Austria
12 shared publications - Helmut Schrom-Feiertag
Center for Technology Experience, AIT Austrian Institute of Technology, Vienna, Austria
10 shared publications - Markus Murtinger
Center for Technology Experience, AIT Austrian Institute of Technology, Vienna, Austria and Paris Lodron University of Salzburg, Salzburg, Austria
6 shared publications - Olivia Zechner
Austrian Institute of Technology
4 shared publications - Anke Sabine Baetzner
Institute of Sports and Sports Sciences, Heidelberg University, Heidelberg, Germany
3 shared publications
Latest Publications
- Open Access
- 2 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-18
The Jury Chooses What It Hears: Ballot-Conditioned Disclosure in a Staged Medea Trial
- 2 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Open AccessThe Jury Chooses What It Hears: Ballot-Conditioned Disclosure in a Staged Medea Trial
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-24
Branching Foresight - A Novel Interaction Concept for AI-generated Scenario Exploration
Climate anxiety often makes the future feel distant and overwhelming. We present Branching Foresight, a self-guided scenario tool that helps individuals explore climate futures through AI-generated scenarios framed as positive, neutral, and challenging trajectories. We position the system as a coping and reflective support tool, where each scenario is enriched with imagery, a conversational coach, and reflection cards. In a single-session study (N = 30), we measured climate transilience, climate-related emotions, creativity support, and user experience, complemented by telemetry and interviews. Results suggest within-subject pre-post improvements in transilience and reductions in negative emotions, with participants reporting strong creativity support and positive experience. As this evidence is single-session and non-comparative, it should be interpreted as initial indications of short-term change rather than superiority over alternative approaches. Qualitative feedback highlighted how the scenarios, imagery, and dialogue made climate futures more concrete and actionable. Our contributions are: (1) an interaction prototype for AI-mediated scenario exploration, (2) initial within-condition pre-post evidence of short-term improvements in perceived coping capacity and transilience during a self-guided session, and (3) design implications for creativity-supportive human-AI interaction in scenario planning.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-24
Open AccessBranching Foresight - A Novel Interaction Concept for AI-generated Scenario Exploration
Climate anxiety often makes the future feel distant and overwhelming. We present Branching Foresight, a self-guided scenario tool that helps individuals explore climate futures through AI-generated scenarios framed as positive, neutral, and challenging trajectories. We position the system as a coping and reflective support tool, where each scenario is enriched with imagery, a conversational coach, and reflection cards. In a single-session study (N = 30), we measured climate transilience, climate-related emotions, creativity support, and user experience, complemented by telemetry and interviews. Results suggest within-subject pre-post improvements in transilience and reductions in negative emotions, with participants reporting strong creativity support and positive experience. As this evidence is single-session and non-comparative, it should be interpreted as initial indications of short-term change rather than superiority over alternative approaches. Qualitative feedback highlighted how the scenarios, imagery, and dialogue made climate futures more concrete and actionable. Our contributions are: (1) an interaction prototype for AI-mediated scenario exploration, (2) initial within-condition pre-post evidence of short-term improvements in perceived coping capacity and transilience during a self-guided session, and (3) design implications for creativity-supportive human-AI interaction in scenario planning.
- Open Access
- 18 December 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-9
ROGER: Visualizing Voice Records to Enhance Team Communication Trainings for High-Stress Situations
- 18 December 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Open AccessROGER: Visualizing Voice Records to Enhance Team Communication Trainings for High-Stress Situations
- Open Access
- 16 June 2025
- Published by Springer Nature in Educational Technology Research and Development
- Vol. 73 (5) , 2861-2875
Mixed reality and real-life exercises for mass casualty incidents: a comparison of psychological responses and learning
Well-prepared medical first responders (MFRs) are indispensable for effectively managing mass casualty incidents (MCIs). Still, the gold standard for training, high-fidelity real-life exercises (RLEs), is infrequently implemented due to high organizational effort and costs. Mixed reality (MR), where MFRs train in a virtual environment with haptic feedback from manikins, may be a viable training alternative. This study aimed to explore strengths, limitations, and potentials for improvement of MR-MCI training in relation to two RLEs. Thirty-four MFRs ( M age = 29.7, SD age = 7.7, 82% male) participated in MR training, 14 MFRs in RLEs (RLE1, akin to MR: n = 4, M age = 32.0, SD age = 9.5; RLE2, near-ideal: n = 14, M age = 26.9, SD age = 6.7; 100% male). Stress, exhaustion, self-efficacy, presence, and perceived learning gain were assessed using questionnaires and analyzed descriptively. Participants further answered open-ended questions about perceived opportunities and limitations of virtual training. The MR and RLE groups reported similar stress, exhaustion, and self-efficacy levels. The MR group reported slightly lower physical presence but considerably lower social presence than the RLE groups. Perceived learning gains were moderate for MR participants and high for RLE participants. Qualitative data indicated a need to improve interaction opportunities with virtual patients. Also, participants viewed virtual training as a resource-efficient supplement, not a replacement for RLEs. Future studies should explore which content and groups benefit most from MR and further evaluate it through larger, experimental studies. MR-MCI training shows promise in preparing MFRs for MCIs and seems to be a valuable addition to RLEs, with the potential to increase training frequency and practice scenarios otherwise difficult to simulate.
- 16 June 2025
- Published by Springer Nature in Educational Technology Research and Development
- Vol. 73 (5) , 2861-2875
Open AccessMixed reality and real-life exercises for mass casualty incidents: a comparison of psychological responses and learning
Well-prepared medical first responders (MFRs) are indispensable for effectively managing mass casualty incidents (MCIs). Still, the gold standard for training, high-fidelity real-life exercises (RLEs), is infrequently implemented due to high organizational effort and costs. Mixed reality (MR), where MFRs train in a virtual environment with haptic feedback from manikins, may be a viable training alternative. This study aimed to explore strengths, limitations, and potentials for improvement of MR-MCI training in relation to two RLEs. Thirty-four MFRs ( M age = 29.7, SD age = 7.7, 82% male) participated in MR training, 14 MFRs in RLEs (RLE1, akin to MR: n = 4, M age = 32.0, SD age = 9.5; RLE2, near-ideal: n = 14, M age = 26.9, SD age = 6.7; 100% male). Stress, exhaustion, self-efficacy, presence, and perceived learning gain were assessed using questionnaires and analyzed descriptively. Participants further answered open-ended questions about perceived opportunities and limitations of virtual training. The MR and RLE groups reported similar stress, exhaustion, and self-efficacy levels. The MR group reported slightly lower physical presence but considerably lower social presence than the RLE groups. Perceived learning gains were moderate for MR participants and high for RLE participants. Qualitative data indicated a need to improve interaction opportunities with virtual patients. Also, participants viewed virtual training as a resource-efficient supplement, not a replacement for RLEs. Future studies should explore which content and groups benefit most from MR and further evaluate it through larger, experimental studies. MR-MCI training shows promise in preparing MFRs for MCIs and seems to be a valuable addition to RLEs, with the potential to increase training frequency and practice scenarios otherwise difficult to simulate.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Embodied Measurement: Tangible Interactions to Enhance the Validity of Self-Report Measures
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessEmbodied Measurement: Tangible Interactions to Enhance the Validity of Self-Report Measures
- Open Access
- 24 April 2025
- Published by Springer Nature in Virtual Reality
- Vol. 29 (2) , 1-25
Mixed reality training for medical first responders: system evaluation and recommendations
This study assesses the integration of mixed reality (MR) technologies in medical first responder (MFR) training, focusing on identifying key factors influencing behavioral intention to use MR systems and practical implications for technology acceptance and enhanced realism through haptic feedback. Through a user-centered design approach, involving co-creation workshops, iterative development, and evaluations in pilot and field trials across six countries, this study evaluated technology acceptance, presence, user experience, and workload among MFRs. Both quantitative measures and qualitative feedback were collected to analyze the determinants of technology acceptance and user engagement. The MED1stMR training system, developed as a result, demonstrates that performance expectancy, effort expectancy, and social presence are significant predictors of behavioral intention to use MR training systems among MFRs. High technology acceptance and positive user experience were reported, with specific emphasis on the educational value of haptic feedback in skill training. Trainer feedback highlighted the importance of real-time performance metrics and openness to AI-driven training assistance for enhancing training outcomes. The study underscores the critical role of realistic patient interaction and the importance of aligning training challenges with users’ skills to create engaging MR training environments for MFRs. Identifying factors influencing behavioral intention offers valuable insights for the development of MR training systems, suggesting a focus on social presence and interactive capabilities to improve realism and educational value. The findings advocate for the integration of adaptive training features and further exploration of AI support in scenario optimization and performance enhancement.
- 24 April 2025
- Published by Springer Nature in Virtual Reality
- Vol. 29 (2) , 1-25
Open AccessMixed reality training for medical first responders: system evaluation and recommendations
This study assesses the integration of mixed reality (MR) technologies in medical first responder (MFR) training, focusing on identifying key factors influencing behavioral intention to use MR systems and practical implications for technology acceptance and enhanced realism through haptic feedback. Through a user-centered design approach, involving co-creation workshops, iterative development, and evaluations in pilot and field trials across six countries, this study evaluated technology acceptance, presence, user experience, and workload among MFRs. Both quantitative measures and qualitative feedback were collected to analyze the determinants of technology acceptance and user engagement. The MED1stMR training system, developed as a result, demonstrates that performance expectancy, effort expectancy, and social presence are significant predictors of behavioral intention to use MR training systems among MFRs. High technology acceptance and positive user experience were reported, with specific emphasis on the educational value of haptic feedback in skill training. Trainer feedback highlighted the importance of real-time performance metrics and openness to AI-driven training assistance for enhancing training outcomes. The study underscores the critical role of realistic patient interaction and the importance of aligning training challenges with users’ skills to create engaging MR training environments for MFRs. Identifying factors influencing behavioral intention offers valuable insights for the development of MR training systems, suggesting a focus on social presence and interactive capabilities to improve realism and educational value. The findings advocate for the integration of adaptive training features and further exploration of AI support in scenario optimization and performance enhancement.
- Open Access
- 11 December 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e58623
Integrating GPT-Based AI into Virtual Patients to Facilitate Communication Training Among Medical First Responders: Usability Study of Mixed Reality Simulation
Background: Training in social-verbal interactions is crucial for medical first responders (MFRs) to assess a patient’s condition and perform urgent treatment during emergency medical service administration. Integrating conversational agents (CAs) in virtual patients (VPs), that is, digital simulations, is a cost-effective alternative to resource-intensive human role-playing. There is moderate evidence that CAs improve communication skills more effectively when used with instructional interventions. However, more recent GPT-based artificial intelligence (AI) produces richer, more diverse, and more natural responses than previous CAs and has control of prosodic voice qualities like pitch and duration. These functionalities have the potential to better match the interaction expectations of MFRs regarding habitability. Objective: We aimed to study how the integration of GPT-based AI in a mixed reality (MR)–VP could support communication training of MFRs. Methods: We developed an MR simulation of a traffic accident with a VP. ChatGPT (OpenAI) was integrated into the VP and prompted with verified characteristics of accident victims. MFRs (N=24) were instructed on how to interact with the MR scenario. After assessing and treating the VP, the MFRs were administered the Mean Opinion Scale-Expanded, version 2, and the Subjective Assessment of Speech System Interfaces questionnaires to study their perception of the voice quality and the usability of the voice interactions, respectively. Open-ended questions were asked after completing the questionnaires. The observed and logged interactions with the VP, descriptive statistics of the questionnaires, and the output of the open-ended questions are reported. Results: The usability assessment of the VP resulted in moderate positive ratings, especially in habitability (median 4.25, IQR 4-4.81) and likeability (median 4.50, IQR 3.97-5.91). Interactions were negatively affected by the approximately 3-second latency of the responses. MFRs acknowledged the naturalness of determining the physiological states of the VP through verbal communication, for example, with questions such as “Where does it hurt?” However, the question-answer dynamic in the verbal exchange with the VP and the lack of the VP’s ability to start the verbal exchange were noticed. Noteworthy insights highlighted the potential of domain-knowledge prompt engineering to steer the actions of MFRs for effective training. Conclusions: Generative AI in VPs facilitates MFRs’ training but continues to rely on instructions for effective verbal interactions. Therefore, the capabilities of the GPT-VP and a training protocol need to be communicated to trainees. Future interactions should implement triggers based on keyword recognition, the VP pointing to the hurting area, conversational turn-taking techniques, and add the ability for the VP to start a verbal exchange. Furthermore, a local AI server, chunk processing, and lowering the audio resolution of the VP’s voice could ameliorate the delay in response and allay privacy concerns. Prompting could be used in future studies to create a virtual MFR capable of assisting trainees.
- 11 December 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e58623
Open AccessIntegrating GPT-Based AI into Virtual Patients to Facilitate Communication Training Among Medical First Responders: Usability Study of Mixed Reality Simulation
Background: Training in social-verbal interactions is crucial for medical first responders (MFRs) to assess a patient’s condition and perform urgent treatment during emergency medical service administration. Integrating conversational agents (CAs) in virtual patients (VPs), that is, digital simulations, is a cost-effective alternative to resource-intensive human role-playing. There is moderate evidence that CAs improve communication skills more effectively when used with instructional interventions. However, more recent GPT-based artificial intelligence (AI) produces richer, more diverse, and more natural responses than previous CAs and has control of prosodic voice qualities like pitch and duration. These functionalities have the potential to better match the interaction expectations of MFRs regarding habitability. Objective: We aimed to study how the integration of GPT-based AI in a mixed reality (MR)–VP could support communication training of MFRs. Methods: We developed an MR simulation of a traffic accident with a VP. ChatGPT (OpenAI) was integrated into the VP and prompted with verified characteristics of accident victims. MFRs (N=24) were instructed on how to interact with the MR scenario. After assessing and treating the VP, the MFRs were administered the Mean Opinion Scale-Expanded, version 2, and the Subjective Assessment of Speech System Interfaces questionnaires to study their perception of the voice quality and the usability of the voice interactions, respectively. Open-ended questions were asked after completing the questionnaires. The observed and logged interactions with the VP, descriptive statistics of the questionnaires, and the output of the open-ended questions are reported. Results: The usability assessment of the VP resulted in moderate positive ratings, especially in habitability (median 4.25, IQR 4-4.81) and likeability (median 4.50, IQR 3.97-5.91). Interactions were negatively affected by the approximately 3-second latency of the responses. MFRs acknowledged the naturalness of determining the physiological states of the VP through verbal communication, for example, with questions such as “Where does it hurt?” However, the question-answer dynamic in the verbal exchange with the VP and the lack of the VP’s ability to start the verbal exchange were noticed. Noteworthy insights highlighted the potential of domain-knowledge prompt engineering to steer the actions of MFRs for effective training. Conclusions: Generative AI in VPs facilitates MFRs’ training but continues to rely on instructions for effective verbal interactions. Therefore, the capabilities of the GPT-VP and a training protocol need to be communicated to trainees. Future interactions should implement triggers based on keyword recognition, the VP pointing to the hurting area, conversational turn-taking techniques, and add the ability for the VP to start a verbal exchange. Furthermore, a local AI server, chunk processing, and lowering the audio resolution of the VP’s voice could ameliorate the delay in response and allay privacy concerns. Prompting could be used in future studies to create a virtual MFR capable of assisting trainees.
- 2 December 2024
- Published by Taylor & Francis in Behaviour & Information Technology
- Vol. 44 (1) , 2-18
Exploring user preferences: customisation and attitudes towards notifications in mobile health and well-being applications
- 2 December 2024
- Published by Taylor & Francis in Behaviour & Information Technology
- Vol. 44 (1) , 2-18
Exploring user preferences: customisation and attitudes towards notifications in mobile health and well-being applications
- Open Access
- 4 June 2024
- Published by MDPI AG in Multimodal Technologies and Interaction
- Vol. 8 (6) , 46
Sound of the Police—Virtual Reality Training for Police Communication for High-Stress Operations
Police communication is a field with unique challenges and specific requirements. Police officers depend on effective communication, particularly in high-stress operations, but current training methods are not focused on communication and provide only limited evaluation methods. This work explores the potential of virtual reality (VR) for enhancing police communication training. The rise of VR training, especially in specific application areas like policing, provides benefits. We conducted a field study during police training to assess VR approaches for training communication. The results show that VR is suitable for communication training if factors such as realism, reflection and repetition are given in the VR system. Trainer feedback shows that assistive systems for evaluation and visualization of communication are highly needed. We present ideas and approaches for evaluation in communication training and concepts for visualization and exploration of the data. This research contributes to improving VR police training and has implications for communication training in VR in challenging contexts.
- 4 June 2024
- Published by MDPI AG in Multimodal Technologies and Interaction
- Vol. 8 (6) , 46
Open AccessSound of the Police—Virtual Reality Training for Police Communication for High-Stress Operations
Police communication is a field with unique challenges and specific requirements. Police officers depend on effective communication, particularly in high-stress operations, but current training methods are not focused on communication and provide only limited evaluation methods. This work explores the potential of virtual reality (VR) for enhancing police communication training. The rise of VR training, especially in specific application areas like policing, provides benefits. We conducted a field study during police training to assess VR approaches for training communication. The results show that VR is suitable for communication training if factors such as realism, reflection and repetition are given in the VR system. Trainer feedback shows that assistive systems for evaluation and visualization of communication are highly needed. We present ideas and approaches for evaluation in communication training and concepts for visualization and exploration of the data. This research contributes to improving VR police training and has implications for communication training in VR in challenging contexts.
- Open Access
- 14 May 2024
- Published by Springer Nature in Research Square
Mixed Reality Training for Medical First Responders: System Evaluation and Recommendations
Purpose: This study assesses the integration of Mixed Reality (MR) technologies in medical first responder (MFR) training, focusing on identifying key factors influencing behavioral intention to use MR systems and practical implications for technology acceptance and enhanced realism through haptic feedback. Methods: Through a User-Centered Design approach, involving co-creation workshops, iterative development, and evaluations in pilot and field trials across six countries, this study evaluated technology acceptance, presence, user experience, and workload among MFRs. Both quantitative measures and qualitative feedback were collected to analyze the determinants of technology acceptance and user engagement. Results: The MED1stMR Training System, developed as a result, demonstrates that performance expectancy, effort expectancy, and social presence are significant predictors of behavioral intention to use MR training systems among MFRs. High technology acceptance and positive user experience were reported, with specific emphasis on the educational value of haptic feedback in skill training. Trainer feedback highlighted the importance of real-time performance metrics and openness to AI-driven training assistance for enhancing training outcomes. Conclusion: The study underscores the critical role of realistic patient interaction and the importance of aligning training challenges with users' skills to create engaging MR training environments for MFRs. Identifying factors influencing behavioral intention offers valuable insights for the development of MR training systems, suggesting a focus on social presence and interactive capabilities to improve realism and educational value. The findings advocate for the integration of adaptive training features and further exploration of AI support in scenario optimization and performance enhancement.
- 14 May 2024
- Published by Springer Nature in Research Square
Open AccessMixed Reality Training for Medical First Responders: System Evaluation and Recommendations
Purpose: This study assesses the integration of Mixed Reality (MR) technologies in medical first responder (MFR) training, focusing on identifying key factors influencing behavioral intention to use MR systems and practical implications for technology acceptance and enhanced realism through haptic feedback. Methods: Through a User-Centered Design approach, involving co-creation workshops, iterative development, and evaluations in pilot and field trials across six countries, this study evaluated technology acceptance, presence, user experience, and workload among MFRs. Both quantitative measures and qualitative feedback were collected to analyze the determinants of technology acceptance and user engagement. Results: The MED1stMR Training System, developed as a result, demonstrates that performance expectancy, effort expectancy, and social presence are significant predictors of behavioral intention to use MR training systems among MFRs. High technology acceptance and positive user experience were reported, with specific emphasis on the educational value of haptic feedback in skill training. Trainer feedback highlighted the importance of real-time performance metrics and openness to AI-driven training assistance for enhancing training outcomes. Conclusion: The study underscores the critical role of realistic patient interaction and the importance of aligning training challenges with users' skills to create engaging MR training environments for MFRs. Identifying factors influencing behavioral intention offers valuable insights for the development of MR training systems, suggesting a focus on social presence and interactive capabilities to improve realism and educational value. The findings advocate for the integration of adaptive training features and further exploration of AI support in scenario optimization and performance enhancement.