SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation
Authors:
- Li YiLYLi Yi
- Hao SuHSHao Su
- Xingwen GuoXGXingwen Guo
- Leonidas GuibasLGLeonidas Guibas
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 6584-6592
Abstract
In this paper, we study the problem of semantic annotation on 3D models that are represented as shape graphs. A functional view is taken to represent localized information on graphs, so that annotations such as part segment or keypoint are nothing but 0-1 indicator vertex functions. Compared with images that are 2D grids, shape graphs are irregular and non-isomorphic data structures. To enable the prediction of vertex functions on them by convolutional neural networks, we resort to spectral CNN method that enables weight sharing by parametrizing kernels in the spectral domain spanned by graph Laplacian eigenbases. Under this setting, our network, named SyncSpecCNN, strives to overcome two key challenges: how to share coefficients and conduct multi-scale analysis in different parts of the graph for a single shape, and how to share information across related but different shapes that may be represented by very different graphs. Towards these goals, we introduce a spectral parametrization of dilated convolutional kernels and a spectral transformer network. Experimentally we tested SyncSpecCNN on various tasks, including 3D shape part segmentation and keypoint prediction. State-of-the-art performance has been achieved on all benchmark datasets.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Vertex-frequency analysis on graphsApplied and Computational Harmonic Analysis, 2016
- 3D Shape Segmentation and Labeling via Extreme Learning MachineComputer Graphics Forum, 2014
- Shape2PoseACM Transactions on Graphics, 2014
- Functional map networks for analyzing and exploring large shape collectionsACM Transactions on Graphics, 2014
- Interactive shape co-segmentation via label propagationComputers & Graphics, 2014
- Fine-grained semi-supervised labeling of large shape collectionsACM Transactions on Graphics, 2013
- Learning part-based templates from large collections of 3D shapesACM Transactions on Graphics, 2013
- Angular synchronization by eigenvectors and semidefinite programmingApplied and Computational Harmonic Analysis, 2011
- Learning 3D mesh segmentation and labelingACM Transactions on Graphics, 2010
- Mesh Segmentation via Spectral Embedding and Contour AnalysisComputer Graphics Forum, 2007