Multi-Space Neural Radiance Fields
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 12407-12416
Abstract
Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects, often resulting in blurry or distorted rendering. Instead of calculating a single radiance field, we propose a multi-space neural radiance field (MS-NeRF) that represents the scene using a group of feature fields in parallel sub-spaces, which leads to a better understanding of the neural network toward the existence of reflective and refractive objects. Our multi-space scheme works as an enhancement to existing NeRF methods, with only small computational overheads needed for training and inferring the extra-space outputs. We demonstrate the superiority and compatibility of our approach using three representative NeRF-based models, i.e., NeRF, Mip-NeRF, and Mip-NeRF 360. Comparisons are performed on a novelly constructed dataset consisting of 25 synthetic scenes and 7 real captured scenes with complex reflection and refraction, all having 360-degree viewpoints. Extensive experiments show that our approach significantly outperforms the existing single-space NeRF methods for rendering high-quality scenes concerned with complex light paths through mirror-like objects. Our code and dataset will be publicly available at https://zx-yin.github.io/msnerf.Keywords
All Related Versions
Funding Information
- Natural Science Foundation of China (62132012)
This publication has 37 references indexed in Scilit:
- D-NeRF: Neural Radiance Fields for Dynamic Scenes2021
- Local light field fusionACM Transactions on Graphics, 2019
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- Tanks and templesACM Transactions on Graphics, 2017
- Structure-from-Motion Revisited2016
- Efficient 3D Object Segmentation from Densely Sampled Light Fields with Applications to 3D ReconstructionACM Transactions on Graphics, 2016
- Large Scale Multi-view Stereopsis Evaluation2014
- Precomputation-Based RenderingFoundations and Trends in Computer Graphics and Vision, 2009
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Optical models for direct volume renderingIEEE Transactions on Visualization and Computer Graphics, 1995