Learning Visual Feedback Control for Dynamic Cloth Folding
Authors:
- 23 October 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1455-1462
Abstract
Robotic manipulation of cloth is a challenging task due to the high dimensionality of the configuration space and the complexity of dynamics affected by various material properties. The effect of complex dynamics is even more pronounced in dynamic folding, for example, when a square piece of fabric is folded in two by a single manipulator. To account for the complexity and uncertainties, feedback of the cloth state using e.g. vision is typically needed. However, construction of visual feedback policies for dynamic cloth folding is an open problem. In this paper, we present a solution that learns policies in simulation using Reinforcement Learning (RL) and transfers the learned policies directly to the real world. In addition, to learn a single policy that manipulates multiple materials, we randomize the material properties in simulation. We evaluate the contributions of visual feedback and material randomization in real-world experiments. The experimental results demonstrate that the proposed solution can fold successfully different fabric types using dynamic manipulation in the real world. Code, data, and videos are available at https://sites.google.com/view/dynamic-cloth-folding.Keywords
All Related Versions
Funding Information
- Research Council of Finland (328399,317020)
This publication has 18 references indexed in Scilit:
- Learning to Manipulate Deformable Objects without Demonstrations2020
- Feedback-based Fabric Strip Folding2019
- Setting up a Reinforcement Learning Task with a Real-World Robot2018
- Domain randomization for transferring deep neural networks from simulation to the real world2017
- MuJoCo: A physics engine for model-based control2012
- A geometric approach to robotic laundry foldingThe International Journal of Robotics Research, 2011
- Combining imitation and reinforcement learning to fold deformable planar objects2011
- Dynamic Manipulation of a Cloth by High-speed Robot System using High-speed Visual FeedbackIFAC Proceedings Volumes, 2011
- Mechanics of Robotic Manipulation2001
- A unified approach for motion and force control of robot manipulators: The operational space formulationIEEE Journal on Robotics and Automation, 1987