FastNeRF: High-Fidelity Neural Rendering at 200FPS
Authors:
Top Cited Papers
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 14326-14335
Abstract
Recent work on Neural Radiance Fields (NeRF) showed how neural networks can be used to encode complex 3D environments that can be rendered photorealistically from novel viewpoints. Rendering these images is very computationally demanding and recent improvements are still a long way from enabling interactive rates, even on high-end hardware. Motivated by scenarios on mobile and mixed reality devices, we propose FastNeRF, the first NeRF-based system capable of rendering high fidelity photorealistic images at 200Hz on a high-end consumer GPU. The core of our method is a graphics-inspired factorization that allows for (i) compactly caching a deep radiance map at each position in space, (ii) efficiently querying that map using ray directions to estimate the pixel values in the rendered image. Extensive experiments show that the proposed method is 3000 times faster than the original NeRF algorithm and at least an order of magnitude faster than existing work on accelerating NeRF, while maintaining visual quality and extensibility.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Learning a model of facial shape and expression from 4D scansACM Transactions on Graphics, 2017
- Deep Shading: Convolutional Neural Networks for Screen Space ShadingComputer Graphics Forum, 2017
- VDBACM Transactions on Graphics, 2013
- Light transport simulation with vertex connection and mergingACM Transactions on Graphics, 2012
- OptiXACM Transactions on Graphics, 2010
- An improved illumination model for shaded display2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Optimally combining sampling techniques for Monte Carlo rendering1995
- Marching cubes: A high resolution 3D surface construction algorithmACM SIGGRAPH Computer Graphics, 1987
- The rendering equationACM SIGGRAPH Computer Graphics, 1986