GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloud
Authors:
- Li YiLYLi Yi
- Wang ZhaoWZWang Zhao
- He WangHWHe Wang
- Minhyuk SungMSMinhyuk Sung
- Leonidas GuibasLGLeonidas Guibas
Preprint
Abstract
We introduce a novel 3D object proposal approach named Generative Shape Proposal Network (GSPN) for instance segmentation in point cloud data. Instead of treating object proposal as a direct bounding box regression problem, we take an analysis-by-synthesis strategy and generate proposals by reconstructing shapes from noisy observations in a scene. We incorporate GSPN into a novel 3D instance segmentation framework named Region-based PointNet (R-PointNet) which allows flexible proposal refinement and instance segmentation generation. We achieve state-of-the-art performance on several 3D instance segmentation tasks. The success of GSPN largely comes from its emphasis on geometric understandings during object proposal, which greatly reducing proposals with low objectness.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- PartNet: A Large-Scale Benchmark for Fine-Grained and Hierarchical Part-Level 3D Object Understanding2019
- PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes2018
- Frustum PointNets for 3D Object Detection from RGB-D Data2018
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- Fully Convolutional Instance-Aware Semantic Segmentation2017
- SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation2017
- ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes2017
- A Point Set Generation Network for 3D Object Reconstruction from a Single Image2017
- A scalable active framework for region annotation in 3D shape collectionsACM Transactions on Graphics, 2016
- Selective Search for Object RecognitionInternational Journal of Computer Vision, 2013