Interactive robot task training through dialog and demonstration
Authors:
Open Access
- 10 March 2007
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 49-56
Abstract
Effective human/robot interfaces which mimic how humans interact with one another could ultimately lead to robots being accepted in a wider domain of applications. We present a framework for interactive task training of a mobile robot where the robot learns how to do various tasks while observing a human. In addition to observation, the robot listens to the human's speech and interprets the speech as behaviors that are required to be executed. This is especially important where individual steps of a given task may have contingencies that have to be dealt with depending on the situation. Finally, the context of the location where the task takes place and the people present factor heavily into the robot's interpretation of how to execute the task. In this paper, we describe the task training framework, describe how environmental context and communicative dialog with the human help the robot learn the task, and illustrate the utility of this approach with several experimental case studies.Keywords
This publication has 10 references indexed in Scilit:
- Grounded Situation Models for Robots: Where words and percepts meet2006
- Teaching robots by moulding behavior and scaffolding the environment2006
- User-guided reinforcement learning of robot assistive tasks for an intelligent environment2004
- Fast and accurate vision-based pattern detection and identification2004
- Natural methods for robot task learning2003
- Monte Carlo localization for mobile robots2003
- Mobile robot programming using natural languageRobotics and Autonomous Systems, 2002
- Building a multimodal human-robot interfaceIEEE Intelligent Systems, 2001
- Towards gesture-based programming: shape from motion primordial learning of sensorimotor primitivesRobotics and Autonomous Systems, 1997
- Learning by watching: extracting reusable task knowledge from visual observation of human performanceIEEE Transactions on Robotics and Automation, 1994