Center-Aware Instance Segmentation for Close Objects in Industrial 3-D Point Cloud Scenes
- 1 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20 (2) , 2812-2821
Abstract
Segmenting small-scale and close 3-D objects from a complicated 3-D point cloud scene is a crucial yet challenging task for industrial scene understanding. Previous 3-D instance segmentation work (such as PointGroup and SoftGroup) suffers from limited accuracy when dealing with objects in close proximity. This article proposes a center-aware 3-D instance segmentation framework that performs two cooperative stages, including bottom-up center-guided instance proposal generation and top-down center-aware instance mask refinement, to jointly address the challenges of segmenting close objects. In the first stage, the object clusters are first segmented from the cluttered background. We propose to determine the center of each object by predicting its k -nearest neighbors with their respective offsets, which enables an instance proposal generated for each object. In the second stage, center-based relative position encoding is performed on all points in each instance proposal. We concatenate the explicitly encoded geometric features (low-level) with high-level semantic features and construct the center-aware feature representation for instance mask prediction. We conducted experiments on a real-world industrial point cloud dataset that involves the important aero-engine component—close clamps in the cluttered scenario. The results show that our proposed method achieves state-of-the-art overall 3-D instance segmentation precision with $\mathbf{AP}_{\mathbf{avg}}$ of 0.905 and $\mathbf{AP}_{\mathbf{90}}$ of 0.736.Keywords
Funding Information
- National Natural Science Foundation of China (61906004)
- Aero Engine Corporation of China through Industry-University-Research Collaboration (HFZL2022CXY020)
This publication has 24 references indexed in Scilit:
- SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation2018
- 3D Semantic Segmentation with Submanifold Sparse Convolutional Networks2018
- PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation2017
- ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Point cloud labeling using 3D Convolutional Neural Network2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Sparse 3D convolutional neural networks2015
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009