Deep learning based pose estimation method using 3D point clouds
- 26 November 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 281-286
Abstract
Pose estimation refers to the acquisition of a rigid transformation of an object relative to its original model coordinate system. This paper proposes a deep learning based approach for pose estimation with point clouds of textureless objects. The contribution of this paper can be summarized as follows: (1) A multi-scale local feature aggregation strategy for emphasizing the neighbor region of interest points. (2) The extension of the original spatial transformer network to point clouds, pose estimation and object classification as the output in a single proposed network. (3) A deep learning model combined with the symmetric function and the multi-scale features to improve the accuracy and robustness of the network model, and a new defined joint loss function by considering the objectives of pose estimation and classification. The experiments are conducted to verify the performance of pose estimation when the point clouds of textureless objects are taken as the input data, which shows that the proposed deep learning framework effectively performs on the pose estimation for both synthetic and real point clouds according to the experimental results.Keywords
Funding Information
- National Natural Science Foundation of China
This publication has 20 references indexed in Scilit:
- Learning high-level features by fusing multi-view representation of MLS point clouds for 3D object recognition in road environmentsISPRS Journal of Photogrammetry and Remote Sensing, 2019
- Learning 3D local surface descriptor for point cloud images of objects in the real-worldRobotics and Autonomous Systems, 2019
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- 3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder2017
- Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation2016
- Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs2016
- Covariance based point cloud descriptors for object detection and recognitionComputer Vision and Image Understanding, 2016
- Model globally, match locally: Efficient and robust 3D object recognition2010
- Registration for 3-D point cloud using angular-invariant featureNeurocomputing, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004