Optimal control with learned local models: Application to dexterous manipulation
Authors:
- 1 May 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 378-383
Abstract
We describe a method for learning dexterous manipulation skills with a pneumatically-actuated tendon-driven 24-DoF hand. The method combines iteratively refitted time-varying linear models with trajectory optimization, and can be seen as an instance of model-based reinforcement learning or as adaptive optimal control. Its appeal lies in the ability to handle challenging problems with surprisingly little data. We show that we can achieve sample-efficient learning of tasks that involve intermittent contact dynamics and under-actuation. Furthermore, we can control the hand directly at the level of the pneumatic valves, without the use of a prior model that describes the relationship between valve commands and joint torques. We compare results from learning in simulation and on the physical system. Even though the learned policies are local, they are able to control the system in the face of substantial variability in initial state.Keywords
This publication has 16 references indexed in Scilit:
- Human-level control through deep reinforcement learningNature, 2015
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Learning to Control a Low-Cost Manipulator using Data-Efficient Reinforcement Learning2011
- A Survey on Policy Search for RoboticsFoundations and Trends in Robotics, 2011
- Reinforcement Learning to adjust Robot Movements to New Situations2010
- Adaptive Optimal Feedback Control with Learned Internal Dynamics Models2010
- Learning and generalization of motor skills by learning from demonstration2009
- Stochastic policy gradient reinforcement learning on a simple 3D biped2005
- TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level PlayNeural Computation, 1994
- A MATHEMATICAL THEORY OF ADAPTIVE CONTROL PROCESSESProceedings of the National Academy of Sciences, 1959