Keypoint-Based Planar Bimanual Shaping of Deformable Linear Objects Under Environmental Constraints With Hierarchical Action Framework
- 8 March 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 5222-5229
Abstract
This letter addresses the problem of contact-based manipulation of deformable linear objects (DLOs) towards desired shapes with a dual-arm robotic system. To alleviate the burden of high-dimensional continuous state-action spaces, we model DLOs as kinematic multibody systems via our proposed keypoint encoding network. This novel encoding is trained on a synthetic labeled image dataset without requiring any manual annotations and can be directly transferred to real manipulation scenarios.Our goal-conditioned policy efficiently rearranges the configuration of the DLO based on the keypoints. The proposed hierarchical action framework tackles the manipulation problem in a coarse-to-fine manner (with high-level task planning and low-level motion control) by leveraging two action primitives. The identification of deformation properties is bypassed since the algorithm replans its motion after each bimanual execution. The conducted experimental results reveal that our method achieves high performance in state representation and shaping manipulation of the DLO under environmental constraints.Keywords
All Related Versions
Funding Information
- Key-Area Research and Development Program of Guangdong Province 2020 (2020B090928001)
- Research Grants Council of Hong Kong (14203917, 15212721)
- Jiangsu Industrial Technology Research Institute Collaborative Research Program Scheme (ZG9V)
- Hong Kong Polytechnic University (UAKU)
This publication has 26 references indexed in Scilit:
- Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a surveyThe International Journal of Robotics Research, 2018
- EMD Net: An Encode–Manipulate–Decode Network for Cloth ManipulationIEEE Robotics and Automation Letters, 2018
- Fourier-Based Shape Servoing: A New Feedback Method to Actively Deform Soft Objects into Desired 2-D Image ContoursIEEE Transactions on Robotics, 2017
- Deep learning a grasp function for grasping under gripper pose uncertainty2016
- Automatic 3-D Manipulation of Soft Objects by Robotic Arms With an Adaptive Deformation ModelIEEE Transactions on Robotics, 2016
- Fully convolutional networks for semantic segmentation2015
- A dynamic and uncalibrated method to visually servo-control elastic deformations by fully-constrained robotic grippers2014
- Quasi-static manipulation of a Kirchhoff elastic rod based on a geometric analysis of equilibrium configurationsThe International Journal of Robotics Research, 2013
- A potential field based approach to multi-robot manipulation2003
- A fast parallel algorithm for thinning digital patternsCommunications of the ACM, 1984