DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistency
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3906-3915
Abstract
Compared to 2D object bounding-box labeling, it is very difficult for humans to annotate 3D object poses, especially when depth images of scenes are unavailable. This paper investigates whether we can estimate the object poses effectively when only RGB images and 2D object annotations are given. To this end, we present a two-step pose estimation framework to attain 6DoF object poses from 2D object bounding-boxes. In the first step, the framework learns to segment objects from real and synthetic data in a weakly-supervised fashion, and the segmentation masks will act as a prior for pose estimation. In the second step, we design a dual-scale pose estimation network, namely DSC-PoseNet, to predict object poses by employing a differential renderer. To be specific, our DSC-PoseNet firstly predicts object poses in the original image scale by comparing the segmentation masks and the rendered visible object masks. Then, we resize object regions to a fixed scale to estimate poses once again. In this fashion, we eliminate large scale variations and focus on rotation estimation, thus facilitating pose estimation. Moreover, we exploit the initial pose estimation to generate pseudo ground-truth to train our DSC-PoseNet in a self-supervised manner. The estimation results in these two scales are ensembled as our final pose estimation. Extensive experiments on widely-used benchmarks demonstrate that our method outperforms state-of-the-art models trained on synthetic data by a large margin and even is on par with several fully-supervised methods.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Fast R-CNN2015
- Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views2015
- Viewpoints and keypoints2015
- Single image 3D object detection and pose estimation for grasping2014
- Discriminatively Trained Templates for 3D Object Detection: A Real Time Scalable Approach2013
- Multimodal templates for real-time detection of texture-less objects in heavily cluttered scenes2011
- Gradient Response Maps for Real-Time Detection of Textureless ObjectsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Discriminative Mixture-of-Templates for Viewpoint Classification2010
- EPnP: An Accurate O(n) Solution to the PnP ProblemInternational Journal of Computer Vision, 2008
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004