Learning Shape Control of Elastoplastic Deformable Linear Objects
Authors:
- 30 May 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4438-4444
Abstract
Deformable object manipulation tasks have long been regarded as challenging robotic problems. However, until recently very little work has been done on the subject, with most robotic manipulation methods being developed for rigid objects. Deformable objects are more difficult to model and simulate, which has limited the use of model-free Reinforcement Learning (RL) strategies, due to their need for large amounts of data that can only be satisfied in simulation. This paper proposes a new shape control task for Deformable Linear Objects (DLOs). More notably, we present the first study on the effects of elastoplastic properties on this type of problem. Objects with elastoplasticity such as metal wires, are found in various applications and are challenging to manipulate due to their nonlinear behavior. We first highlight the challenges of solving such a manipulation task from an RL perspective, particularly in defining the reward. Then, based on concepts from differential geometry, we propose an intrinsic shape representation using discrete curvature and torsion. Finally, we show through an empirical study that in order to successfully solve the proposed task using Deep Deterministic Policy Gradient (DDPG), the reward needs to include intrinsic information about the shape of the DLO.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- A friction-model-based framework for Reinforcement Learning of robotic tasks in non-rigid environments2015
- A Survey of the Differential Geometry of Discrete CurvesThe Mathematical Intelligencer, 2014
- V-REP: A versatile and scalable robot simulation framework2013
- Manipulation of deformable objects without modeling and simulating deformation2013
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Quasi-static manipulation of a Kirchhoff elastic rod based on a geometric analysis of equilibrium configurationsThe International Journal of Robotics Research, 2013
- SOFA: A Multi-Model Framework for Interactive Physical Simulation2012
- Modeling and perception of deformable one-dimensional objects2011
- Static Modeling of Linear Object Deformation Based on Differential GeometryThe International Journal of Robotics Research, 2004
- STRANDS: Interactive Simulation of Thin Solids using Cosserat ModelsComputer Graphics Forum, 2002