GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence
Authors:
Top Cited Papers
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9903-9913
Abstract
We present GigaPose, afast, robust, and accurate method for CAD-based novel object pose estimation in RGB images. GigaPose first leverages discriminative “templates ”, ren-dered images of the CAD models, to recover the out-of-plane rotation and then uses patch correspondences to estimate the four remaining parameters. Our approach samples tem-plates in only a two-degrees-of-freedom space instead of the usual three and matches the input image to the templates using fast nearest-neighbor search in feature space, results in a speedup factor of 35x compared to the state of the art. More-over, GigaPose is significantly more robust to segmentation errors. Our extensive evaluation on the seven core datasets of the BOP challenge demonstrates that it achieves state-of-the-art accuracy and can be seamlessly integrated with existing refinement methods. Additionally, we show the potential of GigaPose with 3D models predicted by recent work on 3D reconstruction from a single image, relaxing the need for CAD models and making 6D pose object estimation much more convenient. Our source code and trained models are publicly available at https://github.conllnv-nguyenlgigaPose.Keywords
All Related Versions
Funding Information
- European Union (101097259)
This publication has 44 references indexed in Scilit:
- Fusing Local Similarities for Retrieval-Based 3D Orientation Estimation of Unseen Objects2022
- PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Tracking2022
- KPAM: KeyPoint Affordances for Category-Level Robotic Manipulation2022
- CosyPose: Consistent Multi-view Multi-object 6D Pose Estimation2020
- Category Level Object Pose Estimation via Neural Analysis-by-Synthesis2020
- BOP Challenge 2020 on 6D Object Localization2020
- DeepIM: Deep Iterative Matching for 6D Pose Estimation2018
- Deep Residual Learning for Image Recognition2016
- Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd2016
- Learning 6D Object Pose Estimation Using 3D Object Coordinates2014