Jaison Puthenkalam
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jaison Puthenkalam has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Manfred Tscheligi
AIT Austrian Institute of Technology
4 shared publications - Setareh Zafari
Austrian Institute of Technology, Vienna, Austria
4 shared publications - Cornelia Gerdenitsch
AIT Austrian Institute of Technology GmbH
2 shared publications - Georg Regal
AIT Austrian Institute of Technology, Vienna, Austria
2 shared publications - Helmut Schrom-Feiertag
Center for Technology Experience, AIT Austrian Institute of Technology, Vienna, Austria
2 shared publications - Lukas Kroeninger
Center for Technology Experience, Austrian Institute of Technology GmbH, Vienna, Austria
2 shared publications
Latest Publications
- Open Access
- 17 August 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 16 (3) , 1-22
Sense the Machine: Using Multi-Modal Cues for Providing Intelligent Guidance
Recent research has demonstrated the potential for representing intelligent guidance using multi-modal cues, yet few guidelines or processes exist to guide the design of such a system. In this article, we seek to address this gap by investigating the design of multi-modal assistant systems for setting the optimal parameters in industrial plants. We present the results of two user studies conducted with a total of 37 participants to evaluate the effectiveness and experience of different combinations of visual ( Highlights and Ambient lights) and haptic ( Clicks and Vibration ) modalities for providing intelligent dynamic guidance. Our findings demonstrate that providing the intelligent guidance with the multi-modality of Highlights+Ambient resulted in shorter task duration and higher practicality than Ambient lights alone. Regarding task accuracy, the Highlights and Vibration outside-zone guidance resulted in no failed attempts. Moreover, Highlights+Ambient+Vibration guidance was rated as having lower usability than Highlights+Ambient , and higher mental demand than merely Highlights .
- 17 August 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 16 (3) , 1-22
Open AccessSense the Machine: Using Multi-Modal Cues for Providing Intelligent Guidance
Recent research has demonstrated the potential for representing intelligent guidance using multi-modal cues, yet few guidelines or processes exist to guide the design of such a system. In this article, we seek to address this gap by investigating the design of multi-modal assistant systems for setting the optimal parameters in industrial plants. We present the results of two user studies conducted with a total of 37 participants to evaluate the effectiveness and experience of different combinations of visual ( Highlights and Ambient lights) and haptic ( Clicks and Vibration ) modalities for providing intelligent dynamic guidance. Our findings demonstrate that providing the intelligent guidance with the multi-modality of Highlights+Ambient resulted in shorter task duration and higher practicality than Ambient lights alone. Regarding task accuracy, the Highlights and Vibration outside-zone guidance resulted in no failed attempts. Moreover, Highlights+Ambient+Vibration guidance was rated as having lower usability than Highlights+Ambient , and higher mental demand than merely Highlights .
- Open Access
- 4 March 2026
- Published by Springer Nature in Virtual Reality
- Vol. 30 (2)
Mixed reality feature priorities for mass casualty incident triage simulation: a descriptive pre-post study
Mixed reality offers an innovative approach to training complex medical skills in mass casualty incident simulations. This pre-post test study aimed to describe mixed reality feature priorities for mass casualty incident simulation from the end-users’ perspective and to explore the extent to which priorities changed following implementation. A mixed reality training program was developed to improve medical first responders’ triage skills in mass casualty incidents. Five European emergency medical service end-user organizations were asked to prioritize mixed reality training features in five content areas: the live training system, equipment, debriefing dashboard, analytics and statistics, and the manikin. The baseline (T1) survey was completed in late-2022. Six field trials were carried out between June 2023 and January 2024. The follow-up (T2) survey and group discussions were completed in early-2024. Follow-up responses tended to be more polarizing, with fewer features rated as must have (T1, 54.1%; T2, 46.4%), and more features rated as should have (T1, 19.6%; T2, 23.9%), could have (T1, 17.6%; T2, 18.4%), and won’t have (T1, 6.4%; T2, 10.7%). Prior to implementation, end-user organizations prioritized mixed reality simulation features that promoted realism. Following implementation end-users were more pragmatic, assigning higher ratings to features that aligned with the required learning goals and objectives for mixed reality mass casualty incident triage training. Changes in end-users’ priorities demonstrate a need to evaluate mixed reality simulation feature priorities before, during, and after implementation to ensure relevant feature selection and technology development.
- 4 March 2026
- Published by Springer Nature in Virtual Reality
- Vol. 30 (2)
Open AccessMixed reality feature priorities for mass casualty incident triage simulation: a descriptive pre-post study
Mixed reality offers an innovative approach to training complex medical skills in mass casualty incident simulations. This pre-post test study aimed to describe mixed reality feature priorities for mass casualty incident simulation from the end-users’ perspective and to explore the extent to which priorities changed following implementation. A mixed reality training program was developed to improve medical first responders’ triage skills in mass casualty incidents. Five European emergency medical service end-user organizations were asked to prioritize mixed reality training features in five content areas: the live training system, equipment, debriefing dashboard, analytics and statistics, and the manikin. The baseline (T1) survey was completed in late-2022. Six field trials were carried out between June 2023 and January 2024. The follow-up (T2) survey and group discussions were completed in early-2024. Follow-up responses tended to be more polarizing, with fewer features rated as must have (T1, 54.1%; T2, 46.4%), and more features rated as should have (T1, 19.6%; T2, 23.9%), could have (T1, 17.6%; T2, 18.4%), and won’t have (T1, 6.4%; T2, 10.7%). Prior to implementation, end-user organizations prioritized mixed reality simulation features that promoted realism. Following implementation end-users were more pragmatic, assigning higher ratings to features that aligned with the required learning goals and objectives for mixed reality mass casualty incident triage training. Changes in end-users’ priorities demonstrate a need to evaluate mixed reality simulation feature priorities before, during, and after implementation to ensure relevant feature selection and technology development.
- Open Access
- 10 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 536-538
"No Pallet Found": Toward Understanding the Relation between User Experience and Trust in Human-Robot Interaction
- 10 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 536-538
Open Access"No Pallet Found": Toward Understanding the Relation between User Experience and Trust in Human-Robot Interaction
- Open Access
- 18 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 66-73
Sensing the Machine: Evaluating Multi-modal Interaction for Intelligent Dynamic Guidance
- 18 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 66-73
Open AccessSensing the Machine: Evaluating Multi-modal Interaction for Intelligent Dynamic Guidance
- Open Access
- 3 December 2023
- Published by Association for Computing Machinery (ACM)
- Vol. 302, 559-561
Feel the Art: Digital, Tangible Postcards for Accessible Cultural Experiences
Access to art and cultural heritage is an important aspect of the well-being of humans. Within the BeauCoup project, we aim to create solutions to improve access to cultural heritage for older adults with and without impairments. In this paper, we present tangible, interactive postcards, which were developed in a user-centered design process within the project. These digital tangible postcards are a cheap, ubiquitous and easily transportable solution to make artworks - especially paintings - interactively accessible to people with visual impairments. We describe the developed solutions and will strive to discuss with the community the general concept, improvements and further application areas.
- 3 December 2023
- Published by Association for Computing Machinery (ACM)
- Vol. 302, 559-561
Open AccessFeel the Art: Digital, Tangible Postcards for Accessible Cultural Experiences
Access to art and cultural heritage is an important aspect of the well-being of humans. Within the BeauCoup project, we aim to create solutions to improve access to cultural heritage for older adults with and without impairments. In this paper, we present tangible, interactive postcards, which were developed in a user-centered design process within the project. These digital tangible postcards are a cheap, ubiquitous and easily transportable solution to make artworks - especially paintings - interactively accessible to people with visual impairments. We describe the developed solutions and will strive to discuss with the community the general concept, improvements and further application areas.
- Open Access
- 11 September 2023
- Published by MDPI AG in Multimodal Technologies and Interaction
- Vol. 7 (9) , 88
Challenges in Virtual Reality Training for CBRN Events
The contemporary geopolitical environment and strategic uncertainty shaped by asymmetric and hybrid threats urge the future development of hands-on training in realistic environments. Training in immersive, virtual environments is a promising approach. Immersive training can support training for contexts that are otherwise hard to access, dangerous, or have high costs. This paper discusses the challenges for virtual reality training in the CBRN (chemical, biological, radioactive, nuclear) domain. Based on initial considerations and a literature review, we conducted a survey and three workshops to gather requirements for CBRN training in virtual environments. We structured the gathered insights into four overarching themes—the future of CBRN training, ethical and safety requirements, evaluation and feedback, and tangible objects and tools. We provide insights on these four themes and discuss recommendations.
- 11 September 2023
- Published by MDPI AG in Multimodal Technologies and Interaction
- Vol. 7 (9) , 88
Open AccessChallenges in Virtual Reality Training for CBRN Events
The contemporary geopolitical environment and strategic uncertainty shaped by asymmetric and hybrid threats urge the future development of hands-on training in realistic environments. Training in immersive, virtual environments is a promising approach. Immersive training can support training for contexts that are otherwise hard to access, dangerous, or have high costs. This paper discusses the challenges for virtual reality training in the CBRN (chemical, biological, radioactive, nuclear) domain. Based on initial considerations and a literature review, we conducted a survey and three workshops to gather requirements for CBRN training in virtual environments. We structured the gathered insights into four overarching themes—the future of CBRN training, ethical and safety requirements, evaluation and feedback, and tangible objects and tools. We provide insights on these four themes and discuss recommendations.
- 24 October 2022
- Published by Springer Nature
- p. 76-88
Upward Influence Tactics: Playful Virtual Reality Approach for Analysing Human Multi-robot Interaction
- 24 October 2022
- Published by Springer Nature
- p. 76-88
Upward Influence Tactics: Playful Virtual Reality Approach for Analysing Human Multi-robot Interaction
- Open Access
- 31 August 2021
- Published by MDPI AG in Multimodal Technologies and Interaction
- Vol. 5 (9) , 51
Understanding the Headless Rider: Display-Based Awareness and Intent-Communication in Automated Vehicle-Pedestrian Interaction in Mixed Traffic
Automated vehicles do not yet have clearly defined signaling methods towards other road users, which could complement natural communication practices with human drivers, such as eye contact or hand gestures. In order to establish trust, external human–machine interfaces (eHMIs) have been proposed, but so far, these have not been widely evaluated in natural traffic contexts. This paper presents a user study where 30 participants interacted with a functional display-based visual eHMI for an automated shuttle in mixed urban traffic. Two distinct features were investigated: the communication of (1) its awareness of different obstacles on the road ahead and (2) of its intention to start or to brake. The results indicate that the majority of participants in general regarded eHMIs as necessary for automated vehicles. When reflecting their experience with the eHMIs, about half of the participants experienced an increased comprehension and safety. The combined presentation of obstacle awareness and vehicle intentions helped more participants to understand the shuttle’s behavior than the presentation of obstacle awareness only, but fewer participants regarded this combination of awareness and intent to be safe. The strength of the found effects on subjective responses varied with regard to age and gender.
- 31 August 2021
- Published by MDPI AG in Multimodal Technologies and Interaction
- Vol. 5 (9) , 51
Open AccessUnderstanding the Headless Rider: Display-Based Awareness and Intent-Communication in Automated Vehicle-Pedestrian Interaction in Mixed Traffic
Automated vehicles do not yet have clearly defined signaling methods towards other road users, which could complement natural communication practices with human drivers, such as eye contact or hand gestures. In order to establish trust, external human–machine interfaces (eHMIs) have been proposed, but so far, these have not been widely evaluated in natural traffic contexts. This paper presents a user study where 30 participants interacted with a functional display-based visual eHMI for an automated shuttle in mixed urban traffic. Two distinct features were investigated: the communication of (1) its awareness of different obstacles on the road ahead and (2) of its intention to start or to brake. The results indicate that the majority of participants in general regarded eHMIs as necessary for automated vehicles. When reflecting their experience with the eHMIs, about half of the participants experienced an increased comprehension and safety. The combined presentation of obstacle awareness and vehicle intentions helped more participants to understand the shuttle’s behavior than the presentation of obstacle awareness only, but fewer participants regarded this combination of awareness and intent to be safe. The strength of the found effects on subjective responses varied with regard to age and gender.