UniGarmentManip: A Unified Framework for Category-Level Garment Manipulation via Dense Visual Correspondence
Authors:
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 16340-16350
Abstract
Garment manipulation (e.g., unfolding, folding and hanging clothes) is essential for future robots to accomplish home-assistant tasks, while highly challenging due to the diversity of garment configurations, geometries and deformations. Although able to manipulate similar shaped garments in a certain task, previous works mostly have to design different policies for different tasks, could not generalize to garments with diverse geometries, and often rely heavily on human-annotated data. In this paper, we leverage the property that, garments in a certain category have similar structures, and then learn the topological dense (point-level) visual correspondence among garments in the category level with different deformations in the self-supervised manner. The topological correspondence can be easily adapted to the functional correspondence to guide the manipulation policies for various downstream tasks, within only one or few-shot demonstrations. Experiments over garments in 3 different categories on 3 representative tasks in diverse scenarios, using one or two arms, taking one or more steps, inputting flat or messy garments, demonstrate the effectiveness of our proposed method. Project page: https://warshallrho.github.io/unigarmentmanip.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62136001)
This publication has 38 references indexed in Scilit:
- GarmentTracking: Category-Level Garment Pose Tracking2023
- AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-Shot Interactions2022
- SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddings2022
- Skeleton Merger: an Unsupervised Aligned Keypoint Detector2021
- Efficient deformable shape correspondence via multiscale spectral manifold wavelets preservation2021
- CLOTH3D: Clothed 3D Humans2020
- Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images2020
- Unsupervised Learning of Dense Shape Correspondence2019
- Efficient Deformable Shape Correspondence via Kernel Matching2017
- Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie GroupsInternational Journal of Computer Vision, 2017