Category-Level Multi-Part Multi-Joint 3D Shape Assembly
Authors:
Preprint
Abstract
Shape assembly composes complex shapes geometries by arranging simple part geometries and has wide applications in autonomous robotic assembly and CAD modeling. Existing works focus on geometry reasoning and neglect the actual physical assembly process of matching and fitting joints, which are the contact surfaces connecting different parts. In this paper, we consider contacting joints for the task of multi-part assembly. A successful joint-optimized assembly needs to satisfy the bilateral objectives of shape structure and joint alignment. We propose a hierarchical graph learning approach composed of two levels of graph representation learning. The part graph takes part geometries as input to build the desired shape structure. The joint-level graph uses part joints information and focuses on matching and aligning joints. The two kinds of information are combined to achieve the bilateral objectives. Extensive experiments demonstrate that our method outperforms previous methods, achieving better shape structure and higher joint alignment accuracy.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Tasks2021
- COALESCE: Component Assembly by Learning to Synthesize Connections2020
- PQ-NET: A Generative Part Seq2Seq Network for 3D Shapes2020
- Form2Fit: Learning Shape Priors for Generalizable Assembly from Disassembly2020
- Content-based CAD assembly model retrieval: Survey and future challengesComputer-Aided Design, 2019
- Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks2019
- Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image AnnotationsInternational Journal of Computer Vision, 2017
- Recovering Functional Mechanical Assemblies from Raw ScansIEEE Transactions on Visualization and Computer Graphics, 2017
- Assembly-based conceptual 3D modeling with unlabeled components using probabilistic factor graphComputer-Aided Design, 2016
- Survey on assembly sequencing: a combinatorial and geometrical perspectiveJournal of Intelligent Manufacturing, 2011