A learning-based framework for depth ordering
Authors:
- 1 June 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 294-301
Abstract
Depth ordering is instrumental for understanding the 3D geometry of an image. Humans are surprisingly good at depth ordering even with abstract 2D line drawings. In this paper we propose a learning-based framework for depth ordering inference. Boundary and junction characteristics are important clues for this task, and we have developed new features based on these attributes. Although each feature individually can produce reasonable depth ordering results, each still has limitations, and we can achieve better performance by combining them. In practice, local depth ordering inferences can be contradictory. Therefore, we propose a Markov Random Field model with terms that are more global than previous work, and use graph optimization to encourage a globally consistent ordering. In addition, to produce better object segmentation for the task of depth ordering, we propose to explicitly enforce closed loops and long edges for the occlusion boundary detection. We collect a new depth-order dataset for this problem, including more than a thousand human-labeled images with various daily objects and configurations. The proposed algorithm shows promising performance over conventional methods on both synthetic and real scenes.Keywords
This publication has 14 references indexed in Scilit:
- Occlusion boundary detection and figure/ground assignment from optical flow2011
- Occlusion-based depth ordering on monocular images with Binary Partition Tree2011
- Single image depth estimation from predicted semantic labels2010
- Figure-ground segmentation improves handled object recognition in egocentric video2010
- A Unified Contour-Pixel Model for Figure-Ground Segmentation2010
- How well do line drawings depict shape?ACM Transactions on Graphics, 2009
- From contours to regions: An empirical evaluation2009
- Make3D: Learning 3D Scene Structure from a Single Still ImageIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Retrospective on “Interpreting line drawings as three-dimensional surfaces”Artificial Intelligence, 1993