LA-Net: LSTM and attention based point cloud down-sampling and its application
Open Access
- 9 February 2023
- journal article
- research article
- Published by SAGE Publications in Measurement and Control
- Vol. 56 (7-8) , 1261-1277
Abstract
At present, the learning-based down-sampling method has achieved good result by using the loss of subsequent tasks to optimize the process of sampling points selection. However, for the current methods there still has two problems, on the one hand, the sampled points may not be in the original point cloud, and the sampled generated points of the sample need to be matched with the original point cloud (re-matching problem), on the other hand, the number of points obtained after matching may be insufficient for the sampling demand, which need to be supplemented by Farthest Point Sampling, nearest neighbor point, or other methods (re-supplement problem). In order to solve the above problems of re-matching and re-supplement in the learning-based sampling method, we propose a new sampling network which based on high score selection strategy. In our method, LSTM (Long Short Term Memory) is used as the feature extraction method to obtain the relational weight which relative to the subsequent tasks. The attention mechanism is used to select the high score points. The experimental results show that the performances of our network (We dubbed it as LA-Net) are better than other sampling methods and achieve the state-of-the-art in the unified benchmark. Detailed ablation studies have also been carried out, which provably affirm the advantage of each component we proposed. Finally, the methods in this paper are applied to a real backbone network to optimize its performance, and real robot grasping experiments are designed to realize automatic robot grasping of multi-target objects in real scenes.Keywords
Funding Information
- Major Project of Hubei Province Technology Innovation (2019AAA071)
- Youth Project of Hubei Natural Science Foundation (2020CFB116)
- National Natural Science Foundation of China (62073249)
This publication has 8 references indexed in Scilit:
- DGCB-Net: Dynamic Graph Convolutional Broad Network for 3D Object Recognition in Point CloudRemote Sensing, 2020
- Fast and Automatic Registration of Terrestrial Point Clouds Using 2D Line FeaturesRemote Sensing, 2020
- 3D2SeqViews: Aggregating Sequential Views for 3D Global Feature Learning by CNN With Hierarchical Attention AggregationIEEE Transactions on Image Processing, 2019
- Monte Carlo convolution for learning on non-uniformly sampled point cloudsACM Transactions on Graphics, 2018
- SeqViews2SeqLabels: Learning 3D Global Features via Aggregating Sequential Views by RNN With AttentionIEEE Transactions on Image Processing, 2018
- Fast Resampling of Three-Dimensional Point Clouds via GraphsIEEE Transactions on Signal Processing, 2017
- Hierarchical Attention Networks for Document Classification2016
- The farthest point strategy for progressive image samplingIEEE Transactions on Image Processing, 1997