基于密度感知和自注意力机制的点云分割算法
Authors:
- 鲁斌LuBin鲁斌鲁斌LuBin
- 刘亚伟LiuYawei刘亚刘亚伟LiuYawei
- 张宇航ZhangYuhang张宇张宇航ZhangYuhang
- 杨振宇YangZhenyu杨振杨振宇YangZhenyu
- 1 January 2024
- journal article
- research article
- Published by Shanghai Institute of Optics and Fine Mechanics in Laser & Optoelectronics Progress
- Vol. 61 (8) , 0811004-0811004-11
Abstract
We propose a 3D point cloud semantic segmentation algorithm based on density awareness and self-attention mechanism to address the issue of insufficient utilization of inter point density information and spatial location features in existing 3D point cloud semantic segmentation algorithms. First, based on the adaptive K-Nearest Neighbor (KNN) algorithm and local density position encoding, a density awareness convolutional module is constructed to effectively extract key density information between points, enhance the depth of information expression of initial input features, and enhance the algorithm's ability to capture local features. Then, a spatial feature self-attention module is constructed to enhance the correlation between global contextual information and spatial location information based on self-attention and spatial-attention mechanisms. The global and local features are effectively aggregated to extract deeper contextual features, enhancing the segmentation performance of the algorithm. Finally, extensive experiments are conducted on the public S3DIS dataset and ScanNet dataset. The experimental results show that the mean intersection over union of our algorithm reaches 69.11% and 72.52%, respectively, shows significant improvement compared with other algorithms, verifying the proposed algorithm has good segmentation and generalization performances.Keywords
This publication has 22 references indexed in Scilit:
- 基于空间图卷积的三维点云语义分割Laser & Optoelectronics Progress, 2023
- Point-Cloud Semantic Segmentation Network Considering NormalsLaser & Optoelectronics Progress, 2022
- LLGF-Net: Learning Local and Global Feature Fusion for 3D Point Cloud Semantic SegmentationElectronics, 2022
- DGPoint:用于三维点云语义分割的动态图卷积网络Laser & Optoelectronics Progress, 2022
- 结合空间注意力与形状特征的三维点云语义分割Laser & Optoelectronics Progress, 2022
- Deep Learning for 3D Point Clouds: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- PCT: Point cloud transformerComputational Visual Media, 2021
- 基于语义分割的深度学习激光点云三维目标检测Chinese Journal of Lasers, 2021
- Scene Segmentation With Dual Relation-Aware Attention NetworkIEEE Transactions on Neural Networks and Learning Systems, 2020
- SEGCloud: Semantic Segmentation of 3D Point Clouds2017