Multi-view 6D Object Pose Estimation and Camera Motion Planning Using RGBD Images
Authors:
- Juil SockJSJuil Sock
- S. Hamidreza KasaeiSKS. Hamidreza Kasaei
- Luis Seabra LopesLLLuis Seabra Lopes
- Tae-Kyun KimTKTae-Kyun Kim
- 1 October 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2228-2235
Abstract
Recovering object pose in a crowd is a challenging task due to severe occlusions and clutters. In active scenario, whenever an observer fails to recover the poses of objects from the current view point, the observer is able to determine the next view position and captures a new scene from another view point to improve the knowledge of the environment, which may reduce the 6D pose estimation uncertainty. We propose a complete active multi-view framework to recognize 6DOF pose of multiple object instances in a crowded scene. We include several components in active vision setting to increase the accuracy: Hypothesis accumulation and verification combines single-shot based hypotheses estimatedfrom previous views and extract the most likely set of hypotheses; an entropy-based Next-Best-View prediction generates next camera position to capture new data to increase the performance; camera motion planning plans the trajectory of the camera based on the view entropy and the cost of movement. Different approaches for each component are implemented and evaluated to show the increase in performance.Keywords
This publication has 16 references indexed in Scilit:
- Look-Ahead Before You Leap: End-to-End Active Recognition by Forecasting the Effect of Motion2016
- 3D object perception and perceptual learning in the RACE projectRobotics and Autonomous Systems, 2016
- Interactive Open-Ended Learning for 3D Object Recognition: An Approach and ExperimentsJournal of Intelligent & Robotic Systems, 2015
- A unified framework for content-aware view selection and planning through view importance2014
- Multi-view object recognition using view-point invariant shape relations and appearance information2013
- MuJoCo: A physics engine for model-based control2012
- 3D Object Detection with Multiple Kinects2012
- A Global Hypotheses Verification Method for 3D Object Recognition2012
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Random sample consensusCommunications of the ACM, 1981