Leveraging Large-Scale Semantic Networks for Adaptive Robot Task Learning and Execution
Authors:
- 1 December 2016
- journal article
- research article
- Published by SAGE Publications in Big Data
- Vol. 4 (4) , 217-235
Abstract
This work seeks to leverage semantic networks containing millions of entries encoding assertions of commonsense knowledge to enable improvements in robot task execution and learning. The specific application we explore in this project is object substitution in the context of task adaptation. Humans easily adapt their plans to compensate for missing items in day-to-day tasks, substituting a wrap for bread when making a sandwich, or stirring pasta with a fork when out of spoons. Robot plan execution, however, is far less robust, with missing objects typically leading to failure if the robot is not aware of alternatives. In this article, we contribute a context-aware algorithm that leverages the linguistic information embedded in the task description to identify candidate substitution objects without reliance on explicit object affordance information. Specifically, we show that the task context provided by the task labels within the action structure of a task plan can be leveraged to disambiguate information within a noisy large-scale semantic network containing hundreds of potential object candidates to identify successful object substitutions with high accuracy. We present two extensive evaluations of our work on both abstract and real-world robot tasks, showing that the substitutions made by our system are valid, accepted by users, and lead to a statistically significant reduction in robot learning time. In addition, we report the outcomes of testing our approach with a large number of crowd workers interacting with a robot in real time.Keywords
This publication has 22 references indexed in Scilit:
- Construction of a 3D object recognition and manipulation database from grasp demonstrationsAutonomous Robots, 2015
- The Role of Functional Affordances in Socializing RobotsInternational Journal of Social Robotics, 2015
- RoboEarth Semantic Mapping: A Cloud Enabled Knowledge-Based ApproachIEEE Transactions on Automation Science and Engineering, 2015
- Analogical Generalization of Activities from Single Demonstration2014
- Crowdsourcing the construction of a 3D object recognition database for robotic grasping2014
- Microsoft COCO: Common Objects in Context2014
- Crowdsourcing Human-Robot Interaction: New Methods and System Evaluation in a Public EnvironmentJournal of Human-Robot Interaction, 2013
- Representation and Exchange of Knowledge About Actions, Objects, and Environments in the RoboEarth FrameworkIEEE Transactions on Automation Science and Engineering, 2013
- ConceptNet — A Practical Commonsense Reasoning Tool-KitBT Technology Journal, 2004
- CYCCommunications of the ACM, 1995