Bayesian View Synthesis and Image-Based Rendering Principles
Authors:
- Sergi PujadesSPSergi Pujades
- Frederic DevernayFDFrederic Devernay
- Bastian GoldlueckeBGBastian Goldluecke
- 1 June 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 3906-3913
Abstract
In this paper, we address the problem of synthesizing novel views from a set of input images. State of the art methods, such as the Unstructured Lumigraph, have been using heuristics to combine information from the original views, often using an explicit or implicit approximation of the scene geometry. While the proposed heuristics have been largely explored and proven to work effectively, a Bayesian formulation was recently introduced, formalizing some of the previously proposed heuristics, pointing out which physical phenomena could lie behind each. However, some important heuristics were still not taken into account and lack proper formalization. We contribute a new physics-based generative model and the corresponding Maximum a Posteriori estimate, providing the desired unification between heuristics-based methods and a Bayesian formulation. The key point is to systematically consider the error induced by the uncertainty in the geometric proxy. We provide an extensive discussion, analyzing how the obtained equations explain the heuristics developed in previous methods. Furthermore, we show that our novel Bayesian model significantly improves the quality of novel views, in particular if the scene geometry estimate is inaccurate.Keywords
This publication has 23 references indexed in Scilit:
- Theory of Optimal View Interpolation with Depth Inaccuracy2010
- Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems2008
- Fields of Experts: A Framework for Learning Image Priors2005
- Blending multiple views2003
- 3-D scene representation as a collection of images2002
- Image-based modeling, rendering, and lightingIEEE Computer Graphics and Applications, 2002
- Rendering with concentric mosaics1999
- Layered depth images1998
- The lumigraph1996
- Light field rendering1996