Examining the Use of Nonverbal Communication in Virtual Agents
Authors:
Open Access
- 28 March 2021
- journal article
- research article
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 37 (17) , 1648-1673
Abstract
Virtual agents are systems that add a social dimension to computing, often featuring not only natural language input but also an embodiment or avatar. This allows them to take on a more social role and leverage the use of nonverbal communication (NVC). In humans, NVC is used for many purposes, including communicating intent, directing attention, and conveying emotion. As a result, researchers have developed agents that emulate these behaviors. However, challenges pervade the design and development of NVC in agents. Some articles reveal inconsistencies in the benefits of agent NVC; others show signs of difficulties in the process of analyzing and implementing behaviors. Thus, it is unclear what the specific outcomes and effects of incorporating NVC in agents and what outstanding challenges underlie development. This survey seeks to review the uses, outcomes, and development of NVC in virtual agents to identify challenges and themes to improve and motivate the design of future virtual agents.Keywords
Funding Information
- National Science Foundation
This publication has 172 references indexed in Scilit:
- Modelling multimodal expression of emotion in a virtual agentPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- Promoting motivation with virtual agents and avatars: role of visual presence and appearancePhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- Pain assessment and treatment disparities: A virtual human technology investigationPain, 2009
- Gaze cueing of attention: Visual attention, social cognition, and individual differences.Psychological Bulletin, 2007
- Gestures Over Video Streams to Support Remote Collaboration on Physical TasksHuman–Computer Interaction, 2004
- Visual Information as a Conversational Resource in Collaborative Physical TasksHuman–Computer Interaction, 2003
- Gaze and task performance in shared virtual environmentsThe Journal of Visualization and Computer Animation, 2002
- The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agentsApplied Artificial Intelligence, 1999
- Animated agents for procedural training in virtual reality: Perception, cognition, and motor controlApplied Artificial Intelligence, 1999
- The Nature of Rapport and Its Nonverbal CorrelatesPsychological Inquiry, 1990