Bayesian Collaborative Denoising for Monte Carlo Rendering
Authors:
- 5 July 2017
- journal article
- conference paper
- Published by Wiley in Computer Graphics Forum
- Vol. 36 (4) , 137-153
Abstract
The stochastic nature of Monte Carlo rendering algorithms inherently produces noisy images. Essentially, three approaches have been developed to solve this issue: improving the ray‐tracing strategies to reduce pixel variance, providing adaptive sampling by increasing the number of rays in regions needing so, and filtering the noisy image as a post‐process. Although the algorithms from the latter category introduce bias, they remain highly attractive as they quickly improve the visual quality of the images, are compatible with all sorts of rendering effects, have a low computational cost and, for some of them, avoid deep modifications of the rendering engine. In this paper, we build upon recent advances in both non‐local and collaborative filtering methods to propose a new efficient denoising operator for Monte Carlo rendering. Starting from the local statistics which emanate from the pixels sample distribution, we enrich the image with local covariance measures and introduce a nonlocal bayesian filter which is specifically designed to address the noise stemming from Monte Carlo rendering. The resulting algorithm only requires the rendering engine to provide for each pixel a histogram and a covariance matrix of its color samples. Compared to state‐of‐the‐art sample‐based methods, we obtain improved denoising results, especially in dark areas, with a large increase in speed and more robustness with respect to the main parameter of the algorithm. We provide a detailed mathematical exposition of our bayesian approach, discuss extensions to multiscale execution, adaptive sampling and animated scenes, and experimentally validate it on a collection of scenes.Keywords
This publication has 26 references indexed in Scilit:
- SURE-based optimization for adaptive sampling and reconstructionACM Transactions on Graphics, 2012
- Light transport simulation with vertex connection and mergingACM Transactions on Graphics, 2012
- On filtering the noise from the random parameters in Monte Carlo renderingACM Transactions on Graphics, 2012
- Secrets of image denoising cuisineActa Numerica, 2012
- Adaptive sampling and reconstruction using greedy error minimizationACM Transactions on Graphics, 2011
- Flash photography enhancement via intrinsic relightingACM Transactions on Graphics, 2004
- Digital photography with flash and no-flash image pairsACM Transactions on Graphics, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Global Illumination using Photon Maps1996
- The rendering equationACM SIGGRAPH Computer Graphics, 1986