Acquisition and use of transferable, spatio-temporal plan representations for human-robot interaction
Authors:
- 1 October 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 5220-5226
Abstract
Service robots that work together with humans in domestic and constantly changing environments should have a general understanding about their human partners and the tasks that are to be performed. This would enable them to verify their beliefs about the common tasks and the goals of their human partners and detect unexpected events and failures. In this paper we present a way of acquiring general, spatio-temporal plan representations from human motion tracking data in different environments. Using an annotated data set for table setting tasks in a typical kitchen environment, we first cluster the static positions of the participants and create a spatial model relative to furniture objects that are given by a semantic map and linked to a knowledge base. Based on this spatial model learned in one kitchen, we automatically generate spatio-temporal plan representations in different kitchen environments with known semantic maps. We show that our models can successfully be used to give a robot a basic understanding about a task executed by a human in three different environments. We evaluate the quality of our automatic generation of the plan representations and present an example application of plan supervision using a learned model from one kitchen to differentiate tasks performed by humans in other kitchens.Keywords
This publication has 13 references indexed in Scilit:
- Search in the real world: Active visual object search based on spatial relations2011
- KNOWROB-MAP - knowledge-linked semantic object maps2010
- KNOWROB — knowledge processing for autonomous personal robots2009
- Action-related place-based mobile manipulation2009
- Recognizing daily activities with RFID-based sensors2009
- The TUM Kitchen Data Set of everyday manipulation activities for motion tracking and action recognition2009
- Conceptual spatial representations for indoor mobile robotsRobotics and Autonomous Systems, 2008
- A Normalized Levenshtein Distance MetricIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Learning and Detecting Activities from Movement Trajectories Using the Hierarchical Hidden Markov Models2005
- Mining models of human activities from the web2004