Unsupervised 3D Shape Reconstruction by Part Retrieval and Assembly
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 8559-8567
Abstract
Representing a 3D shape with a set of primitives can aid perception of structure, improve robotic object manipulation, and enable editing, stylization, and compression of 3D shapes. Existing methods either use simple parametric primitives or learn a generative shape space of parts. Both have limitations: parametric primitives lead to coarse approximations, while learned parts offer too little control over the decomposition. We instead propose to decompose shapes using a library of 3D parts provided by the user, giving full control over the choice of parts. The library can contain parts with high-quality geometry that are suitable for a given category, resulting in meaningful decompositions with clean geometry. The type of decomposition can also be controlled through the choice of parts in the library. Our method works via a unsupervised approach that iteratively retrieves parts from the library and refines their placements. We show that this approach gives higher reconstruction accuracy and more desirable decompositions than existing approaches. Additionally, we show how the decomposition can be controlled through the part library by using different part libraries to reconstruct the same shapes.Keywords
All Related Versions
Funding Information
- NSF (1941808)
This publication has 22 references indexed in Scilit:
- GRASSACM Transactions on Graphics, 2017
- Learning Shape Abstractions by Assembling Volumetric Primitives2017
- Generalized cylinder decompositionACM Transactions on Graphics, 2015
- Shape Segmentation by Approximate Convexity AnalysisACM Transactions on Graphics, 2014
- Weak Convex Decomposition by Lines‐of‐sightComputer Graphics Forum, 2013
- Structure recovery by part assemblyACM Transactions on Graphics, 2012
- A probabilistic model for component-based shape synthesisACM Transactions on Graphics, 2012
- Approximate convex decomposition of polyhedra and its applicationsComputer Aided Geometric Design, 2008
- Gaussian Mean-Shift Is an EM AlgorithmIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Modeling by example2004