Learning Turn-Taking Behavior from Human Demonstrations for Social Human-Robot Interactions
Authors:
- 23 October 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7643-7649
Abstract
Turn-taking is a fundamental behavior during human interactions and robots must be capable of turn-taking to interact with humans. Current state-of-the-art approaches in turn-taking focus on developing general models to predict the end of turn (EoT) across all contexts. This demands an all-inclusive verbal and non-verbal behavioral dataset from all possible contexts of interaction. Before robot deployment, gathering such a dataset may be infeasible and/or impractical. More importantly, a robot needs to predict the EoT and decide on the best time to take a turn (i.e, start speaking). In this research, we present a learning from demonstration (LfD) system for a robot to learn from demonstrations, after it has been deployed, to make decisions on the appropriate time for taking a turn within specific social interaction contexts. The system captures demonstrations of turn-taking during social interactions and uses these demonstrations to train a LSTM RNN based model to replicate the turn-taking behavior of the demonstrator. We evaluate the system for teaching the turn-taking behavior of an interviewer during a job interview context. Furthermore, we investigate the efficacy of verbal, prosodic, and gestural cues for deciding when to begin a turn.Keywords
Funding Information
- National Science Foundation (1948224)
This publication has 28 references indexed in Scilit:
- Timing in turn-taking and its implications for processing models of languageFrontiers in Psychology, 2015
- Socially Assistive Robots: A Comprehensive Approach to Extending Independent LivingInternational Journal of Social Robotics, 2013
- Exploring minimal nonverbal interruption in HRI2011
- A survey of robot learning from demonstrationRobotics and Autonomous Systems, 2009
- Towards a Better Understanding of Context and Context-Awareness1999
- Measurement and reliability of nonverbal behaviorJournal of Nonverbal Behavior, 1987
- Models of Turn Taking in Conversational InteractionJournal of Language and Social Psychology, 1984
- Turn-taking in ConversationsJournal of Communication, 1975
- A simplest systematics for the organization of turn-taking for conversationLanguage, 1974
- Some signals and rules for taking speaking turns in conversations.Journal of Personality and Social Psychology, 1972