Multi-scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation
Authors:
- Dan XuDXDan Xu
- Elisa RicciERElisa Ricci
- Wanli OuyangWOWanli Ouyang
- Xiaogang WangXWXiaogang Wang
- Nicu SebeNSNicu Sebe
Top Cited Papers
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 161-169
Abstract
This paper addresses the problem of depth estimation from a single still image. Inspired by recent works on multi-scale convolutional neural networks (CNN), we propose a deep model which fuses complementary information derived from multiple CNN side outputs. Different from previous methods, the integration is obtained by means of continuous Conditional Random Fields (CRFs). In particular, we propose two different variations, one based on a cascade of multiple CRFs, the other on a unified graphical model. By designing a novel CNN implementation of mean-field updates for continuous CRFs, we show that both proposed models can be regarded as sequential deep networks and that training can be performed end-to-end. Through extensive experimental evaluation we demonstrate the effectiveness of the proposed approach and establish new state of the art results on publicly available datasets.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Deep convolutional neural fields for depth estimation from a single image2015
- Towards unified depth and semantic prediction from a single image2015
- DeepEdge: A multi-scale bifurcated deep network for top-down contour detection2015
- Fully convolutional networks for semantic segmentation2015
- Depth Transfer: Depth Extraction from Video Using Non-Parametric SamplingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Indoor Segmentation and Support Inference from RGBD Images2012
- Fast High‐Dimensional Filtering Using the Permutohedral LatticeComputer Graphics Forum, 2010
- 3-D Depth Reconstruction from a Single Still ImageInternational Journal of Computer Vision, 2007
- A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image2006
- Automatic photo pop-upACM Transactions on Graphics, 2005