Timed Petri nets for fluent turn-taking over multimodal interaction resources in human-robot collaboration
Authors:
- 10 March 2016
- journal article
- research article
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 35 (11) , 1330-1353
Abstract
The goal of this work is to develop computational models of social intelligence that enable robots to work side by side with humans, solving problems and achieving task goals through dialogue and collaborative manipulation. A defining problem of collaborative behavior in an embodied setting is the manner in which multiple agents make use of shared resources. In a situated dialogue, these resources include physical bottlenecks such as objects or spatial regions, and cognitive bottlenecks such as the speaking floor. For a robot to function as an effective collaborative partner with a human, it must be able to seize and yield such resources appropriately according to social expectations. We describe a general framework that uses timed Petri nets for the modeling and execution of robot speech, gaze, gesture, and manipulation for collaboration. The system dynamically monitors resource requirements and availability to control real-time turn-taking decisions over resources that are shared with humans, reasoning about different resource types independently. We evaluate our approach with an experiment in which our robot Simon performs a collaborative assembly task with 26 different human partners, showing that the multimodal reciprocal approach results in superior task performance, fluency, and balance of control.Keywords
This publication has 54 references indexed in Scilit:
- Design and Impact of Hesitation Gestures during Human-Robot Resource ConflictsJournal of Human-Robot Interaction, 2013
- Controlling Social Dynamics with a Parametrized Model of Floor RegulationJournal of Human-Robot Interaction, 2013
- A multi-expert model for dialogue and behavior control of conversational robots and agentsKnowledge-Based Systems, 2011
- Speaking while monitoring addressees for understandingJournal of Memory and Language, 2004
- Navigating joint projects with dialogueCognitive Science, 2003
- Overlapping talk and the organization of turn-taking for conversationLanguage in Society, 2000
- The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agentsApplied Artificial Intelligence, 1999
- Petri nets: Properties, analysis and applicationsProceedings of the IEEE, 1989
- Representation of assembly and automatic robot planning by Petri netIEEE Transactions on Systems, Man, and Cybernetics, 1989
- On the structure of speaker–auditor interaction during speaking turnsLanguage in Society, 1974