Image-Based 3D Model Retrieval for Indoor Scenes by Simulating Scene Context
- 1 October 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3658-3662
Abstract
We propose a single image-based 3D model retrieval method for indoor scenes. By simulating the scene context of the input image, our method is able to handle several challenging scenarios featuring cluttered backgrounds and severe occlusions. To use our system, the user only needs to drag a few semantic bounding boxes for the query objects. The proposed approach then retrieves the most similar 3D models from the ShapeNet model repository, and aligns them with the corresponding objects automatically. This requires that the 3D models are represented by calibrated view-dependent visual elements learned from the rendered views. With the estimated occlusion relationships, the rendered model images are stacked at the corresponding locations to simulate the scene context. By conducting matching between these synthesized scenes and the input image, the most similar 3D models under the approximate poses are retrieved. Moreover, we show that the retrieving time can be significantly reduced based on a novel greedy algorithm. Experimental results demonstrate the effectiveness of our proposed method.Keywords
This publication has 12 references indexed in Scilit:
- View-based 3D object retrieval with discriminative viewsNeurocomputing, 2017
- Normal Guided Data-Driven Semantic Modeling from a Single Indoor Image2016
- Fast 2D-to-3D matching with camera pose voting for 3D object identification2016
- Marr Revisited: 2D-3D Alignment via Surface Normal Prediction2016
- Seeing 3D Chairs: Exemplar Part-Based 2D-3D Alignment Using a Large Dataset of CAD Models2014
- Beyond PASCAL: A benchmark for 3D object detection in the wild2014
- Ensemble of exemplar-SVMs for object detection and beyond2011
- Non-iterative approach for fast and accurate vanishing point detection2009
- Histograms of Oriented Gradients for Human Detection2005
- Description of shape information for 2-D and 3-D objectsSignal Processing: Image Communication, 2000