Speaking with Objects: Conversational Agents’ Embodiment in Virtual Museums
Authors:
- 21 October 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 279-288
Abstract
Conversational agents in virtual environments are an established approach for immersively conveying the information and narratives of museums and cultural heritage while expanding their accessibility to a wider and remote audience. The rapid development of large language models and text-to-speech technologies has raised the agents’ conversational level significantly, which allows their use for proactive guidance of visitors. This raises the vital question of how such agents should be visually represented to promote Knowledge transfer in immersive virtual environments. In this paper, we compared two representation concepts for agent embodiments in the context of a virtual museum by examining a stylized humanoid guide and a novel animism-based approach that enables users to talk to exhibited objects. Our work addresses the challenge of naturally introducing a virtual educational environment to users and encouraging their interest and engagement with the content. A user study $(N=29)$ revealed high usability and similar presence scores for the experience with each of the embodiments. A majority of participants showed a preference for the animated objects. In terms of user experience, they evoked significant stimulation and high levels of engagement. Our results suggest that agents that show emotions through appropriate word choice influence engagement levels. Based on our findings, we recommend humanoid guides for delivering general background information, while animated objects promote detailed questions about their own stories and a more stimulating exchange.
Keywords
Funding Information
- Ministry of Education
This publication has 44 references indexed in Scilit:
- A Taxonomy of Social Cues for Conversational AgentsInternational Journal of Human-Computer Studies, 2019
- Effects of virtual agent and object representation on experiencing exhibited artifactsComputers & Graphics, 2019
- Virtual humans in cultural heritage ICT applications: A reviewJournal of Cultural Heritage, 2018
- Being there again – Presence in real and virtual environments and its relation to usability and user experience using a mobile navigation taskInternational Journal of Human-Computer Studies, 2017
- Venturing into the uncanny valley of mind—The influence of mind attribution on the acceptance of human-like characters in a virtual reality settingCognition, 2017
- Principles Based on Social Cues in Multimedia Learning: Personalization, Voice, Image, and Embodiment Principles2014
- Fostering social agency in multimedia learning: Examining the impact of an animated agent’s voiceContemporary Educational Psychology, 2005
- A Descriptive Framework of Workspace Awareness for Real-Time GroupwareComputer Supported Cooperative Work (CSCW), 2002
- Rubber hands ‘feel’ touch that eyes seeNature, 1998
- Seeking Generic Motivations for Visiting and Not Visiting Museums and Like Cultural AttractionsMuseum Management and Curatorship, 1997