Learning compositional models of robot skills for task and motion planning
Top Cited Papers
- 6 April 2021
- journal article
- research article
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 40 (6-7) , 866-894
Abstract
The objective of this work is to augment the basic abilities of a robot by learning to use sensorimotor primitives to solve complex long-horizon manipulation problems. This requires flexible generative planning that can combine primitive abilities in novel combinations and, thus, generalize across a wide variety of problems. In order to plan with primitive actions, we must have models of the actions: under what circumstances will executing this primitive successfully achieve some particular effect in the world? We use, and develop novel improvements to, state-of-the-art methods for active learning and sampling. We use Gaussian process methods for learning the constraints on skill effectiveness from small numbers of expensive-to-collect training examples. In addition, we develop efficient adaptive sampling methods for generating a comprehensive and diverse sequence of continuous candidate control parameter values (such as pouring waypoints for a cup) during planning. These values become end-effector goals for traditional motion planners that then solve for a full robot motion that performs the skill. By using learning and planning methods in conjunction, we take advantage of the strengths of each and plan for a wide variety of complex dynamic manipulation tasks. We demonstrate our approach in an integrated system, combining traditional robotics primitives with our newly learned models using an efficient robot task and motion planner. We evaluate our approach both in simulation and in the real world through measuring the quality of the selected primitive actions. Finally, we apply our integrated system to a variety of long-horizon simulated and real-world manipulation problems.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Safe Exploration for Active Learning with Gaussian Processes2015
- Combined task and motion planning through an extensible planner-independent interface layer2014
- Integrated task and motion planning in belief spaceThe International Journal of Robotics Research, 2013
- Determinantal Point Processes for Machine LearningFoundations and Trends in Machine Learning, 2012
- Gaussian process occupancy mapsThe International Journal of Robotics Research, 2012
- Learning to pour with a robot arm combining goal and shape learning for dynamic movement primitivesRobotics and Autonomous Systems, 2011
- 3D is here: Point Cloud Library (PCL)2011
- Regret in the On-Line Decision ProblemGames and Economic Behavior, 1999
- Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learningArtificial Intelligence, 1999
- Random sample consensusCommunications of the ACM, 1981