Semi-situated learning of verbal and nonverbal content for repeated human-robot interaction
Authors:
Open Access
- 31 October 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 13-20
Abstract
Content authoring of verbal and nonverbal behavior is a limiting factor when developing agents for repeated social interactions with the same user. We present PIP, an agent that crowdsources its own multimodal language behavior using a method we call semi-situated learning. PIP renders segments of its goal graph into brief stories that describe future situations, sends the stories to crowd workers who author and edit a single line of character dialog and its manner of expression, integrates the results into its goal state representation, and then uses the authored lines at similar moments in conversation. We present an initial case study in which the language needed to host a trivia game interaction is learned pre-deployment and tested in an autonomous system with 200 users \"in the wild.\" The interaction data suggests that the method generates both meaningful content and variety of expression.Keywords
This publication has 18 references indexed in Scilit:
- Empathic Robots for Long-term InteractionInternational Journal of Social Robotics, 2014
- Crowdsourcing Language Generation Templates for Dialogue Systems2014
- Chorus2013
- Crowdsourcing Human-Robot Interaction: New Methods and System Evaluation in a Public EnvironmentJournal of Human-Robot Interaction, 2013
- Social Robots for Long-Term Interaction: A SurveyInternational Journal of Social Robotics, 2013
- A crowdsourcing method to develop virtual human conversational agentsInternational Journal of Human-Computer Studies, 2012
- Furhat: A Back-Projected Human-Like Robot Head for Multiparty Human-Machine Interaction2012
- MAINTAINING ENGAGEMENT IN LONG-TERM INTERVENTIONS WITH RELATIONAL AGENTSApplied Artificial Intelligence, 2010
- Crowdsourcing user studies with Mechanical Turk2008
- Visual prosody: facial movements accompanying speech2002