Abstract
Predicting 6D object pose is an essential task in vision measurement for robotic manipulation. RGB-based methods have a natural disadvantage due to the lack of 3D information, thus leading to inferior results. Therefore, exploiting the geometry information in depth images is crucial to achieve accurate predictions. To this end, we propose a multi-scale point cloud Transformer (MSPCT) to better learn point cloud feature representations. MSPCT mainly consists of three types of modules: Local Transformer (LT), DownSampling module and Global Transformer (GT). Specifically, the Local Transformer is designed to dynamically divide a local region centered on each point and further extract point-level feature with local context awareness. The DownSampling module is utilized to decrease the resolution and enlarge the receptive field. Global Transformer is employed to capture global-range dependencies between extracted local features. Based on the proposed Transformer blocks, we design a network architecture for object pose estimation, where we further obtain multi-scale features by fusing the local features from LT and global features from GT to predict object’s pose. Extensive experiments verify the effectiveness of Local Transformer and Global Transformer, and our pose estimation pipeline achieves promising results on three benchmark datasets.
Funding Information
  • National Natural Science Foundation of China (61733013, 62073245, 62173248)
  • Suzhou Science and Technology Development Plan Project (SGC2021035)
  • Special funds for Jiangsu Science and Technology Plan (BE2022119)