BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fields
Preprint
Abstract
Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D objects from 2D images. By leveraging an interpolation approach, NeRF can produce new 3D reconstructed views of complicated scenes. Rather than directly restoring the whole 3D scene geometry, NeRF generates a volumetric representation called a ``radiance field,'' which is capable of creating color and density for every point within the relevant 3D space. The broad appeal and notoriety of NeRF make it imperative to examine the existing research on the topic comprehensively. While previous surveys on 3D rendering have primarily focused on traditional computer vision-based or deep learning-based approaches, only a handful of them discuss the potential of NeRF. However, such surveys have predominantly focused on NeRF's early contributions and have not explored its full potential. NeRF is a relatively new technique continuously being investigated for its capabilities and limitations. This survey reviews recent advances in NeRF and categorizes them according to their architectural designs, especially in the field of novel view synthesis.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- AutoRF: Learning 3D Object Radiance Fields from Single View Observations2022
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction2022
- Towards efficient and photorealistic 3D human reconstruction: A brief surveyVisual Informatics, 2021
- A survey on deep learning in medical image reconstructionIntelligent Medicine, 2021
- GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields2021
- 3D reconstruction of spine image from 2D MRI slices along one axisIET Image Processing, 2020
- Deep learning for biomedical image reconstruction: a surveyArtificial Intelligence Review, 2020
- A Methodological Review of 3D Reconstruction Techniques in Tomographic ImagingJournal of Medical Systems, 2018
- Matterport3D: Learning from RGB-D Data in Indoor Environments2017
- Optical models for direct volume renderingIEEE Transactions on Visualization and Computer Graphics, 1995