Combining imitation and reinforcement learning to fold deformable planar objects
Authors:
- 1 September 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1405-1412
Abstract
Research on robotic manipulation has primarily focused on grasping rigid objects using a single manipulator. It is however evident that in order to be truly pervasive, service robots will need to handle deformable objects, possibly with two arms. In this paper we tackle the problem of using cooperative manipulators to perform towel folding tasks. Differently from other approaches, our method executes what we call a momentum fold - a swinging motion that exploits the dynamics of the object being manipulated. We propose a new learning algorithm that combines imitation and reinforcement learning. Human demonstrations are used to reduce the search space of the reinforcement learning algorithm, which then quickly converges to its final solution. The strengths of the algorithm come from its efficient processing, fast learning capabilities, absence of a deformable object model, and applicability to other problems exhibiting temporally incoherent parameter spaces. A wide range of experiments were performed on a robotic platform, demonstrating the algorithm's capability and practicality.Keywords
This publication has 14 references indexed in Scilit:
- Parametrized shape models for clothing2011
- Bringing clothing into desired configurations with limited perception2011
- Learning the skill of archery by a humanoid robot iCub2010
- Robot motor skill coordination with EM-based Reinforcement Learning2010
- Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding2010
- Learning at the level of synergies for a robot weightlifterRobotics and Autonomous Systems, 2006
- A Motion-Planning Approach to Folding: From Paper Craft to Protein FoldingIEEE Transactions on Robotics and Automation, 2004
- Computational approaches to motor learning by imitationPhilosophical Transactions of the Royal Society B: Biological Sciences, 2003
- Folding cartons with fixtures: a motion planning approachIEEE Transactions on Robotics and Automation, 2000
- Least-squares fitting algorithms of the NIST algorithm testing systemJournal of Research of the National Institute of Standards and Technology, 1998