6D pose estimation of object based on fused region-level feature in cluttered scenes
- 18 April 2023
- journal article
- research article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 34 (7) , 075402
Abstract
RGB-based methods have certain disadvantages because they lack 3D information and cannot cope with the pose estimation problem in cluttered scenes. Therefore, we propose a region-level pose estimation network that uses RGB-D images. We first extracted the objects’ color features and geometric features by convolutional neural networks (CNN) and PointNet, respectively, and then performed feature fusion. The fused features were fed into a region-level feature extraction network to obtain the region-level features, which extracted the local geometry features from the point cloud and learned the point set’s semantic information. We used the output of the region-level feature extraction network to perform region-level pose estimation, then selected the pose with the highest confidence level as the output and iteratively optimized the pose to obtain the final results. The experimental results showed that the proposed solution performed well on the LINEMOD data set, which verified the effectiveness of the proposed method in the pose estimation problem and the algorithm’s robustness in severely cluttered scenes.Keywords
Funding Information
- Shanhai Normal University (SK202123)
- Natural Science Foundation of Shanghai Municipality (20ZR1440500)
- Pudong New Area Science & Technology Development Fund (PKX2021-R07)
This publication has 18 references indexed in Scilit:
- 6D pose estimation using an improved method based on point pair features2018
- A scalable active framework for region annotation in 3D shape collectionsACM Transactions on Graphics, 2016
- ORB-SLAM: A Versatile and Accurate Monocular SLAM SystemIEEE Transactions on Robotics, 2015
- Learning descriptors for object recognition and 3D pose estimation2015
- Model globally, match locally: Efficient and robust 3D object recognition2010
- EPnP: An Accurate O(n) Solution to the PnP ProblemInternational Journal of Computer Vision, 2008
- SURF: Speeded Up Robust Features2006
- Stable real-time 3D tracking using online and offline informationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Object recognition from local scale-invariant features1999
- Method for registration of 3-D shapes1992