In Touch We Decide: Physical Touch by Embodied Virtual Agent Increases the Acceptability of Advice
Open Access
- 12 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (5) , 2839-2847
Abstract
Trust in agents within Virtual Reality is becoming increasingly important, as they provide advice and influence people's decision-making. However, previous studies show that encountering speech recognition errors can reduce users' trust in agents. Such errors lead users to ignore the agent's advice and make suboptimal decisions. While agents can offer an apology to repair trust, its effectiveness is often limited because it fails to fully repair the original level of trust. Therefore, we examined the use of social touch, a social interaction involving physical interaction between users and the virtual agent, to enhance the effect of an apology on trust repair and to increase the acceptability of its advice. In a controlled experiment (N=24), participants experienced a robotic arm touching the back of their hands while interacting with the agent before decision-making. The results showed that social touch did not repair participants' trust in agents. However, participants were more likely to accept the agent's advice when they experienced touch with physical feedback, regardless of the level of trust in the agent. We discuss the role of presenting physical haptic feedback and its influence on human-agent interactions in VR.Keywords
Funding Information
- JST COI-NEXT (JPMJPF2201)
This publication has 55 references indexed in Scilit:
- Toward understanding embodied human‐virtual character interaction through virtual and tactile huggingComputer Animation and Virtual Worlds, 2021
- A Touching Connection: How Observing Robotic Touch Can Affect Human Trust in a RobotInternational Journal of Social Robotics, 2021
- Human–virtual character interaction: Toward understanding the influence of haptic feedbackComputer Animation and Virtual Worlds, 2019
- Audio-Visual Stimuli Change not Only Robot’s Hug Impressions but Also Its Stress-Buffering EffectsInternational Journal of Social Robotics, 2019
- Influence of Embodiment and Substrate of Social Robots on Users’ Decision-Making and AttitudeInternational Journal of Social Robotics, 2018
- Social Touch in Human–Robot Interaction: Robot-Initiated Touches can Induce Positive Responses without Extensive Prior BondingInternational Journal of Social Robotics, 2018
- Softness, Warmth, and Responsiveness Improve Robot HugsInternational Journal of Social Robotics, 2018
- The Role of Trust in Human-Robot Interaction2018
- Initial Formation of Trust: Designing an Interaction with Geminoid-DK to Promote a Positive Attitude for Cooperation2011
- The Benefits of Interactions with Physically Present Robots over Video-Displayed AgentsInternational Journal of Social Robotics, 2010