ROSGS: Relightable Outdoor Scenes With Gaussian Splatting
Authors:
- Lianjun LiaoLLLianjun Liao
- Chunhui ZhangCZChunhui Zhang
- Tong WuTWTong Wu
- Henglei LvHLHenglei Lv
- Bailin DengBDBailin Deng
- Lin GaoLGLin Gao
Preprint
Abstract
Image data captured outdoors often exhibit unbounded scenes and unconstrained, varying lighting conditions, making it challenging to decompose them into geometry, reflectance, and illumination. Recent works have focused on achieving this decomposition using Neural Radiance Fields (NeRF) or the 3D Gaussian Splatting (3DGS) representation but remain hindered by two key limitations: the high computational overhead associated with neural networks of NeRF and the use of low-frequency lighting representations, which often result in inefficient rendering and suboptimal relighting accuracy. We propose ROSGS, a two-stage pipeline designed to efficiently reconstruct relightable outdoor scenes using the Gaussian Splatting representation. By leveraging monocular normal priors, ROSGS first reconstructs the scene's geometry with the compact 2D Gaussian Splatting (2DGS) representation, providing an efficient and accurate geometric foundation. Building upon this reconstructed geometry, ROSGS then decomposes the scene's texture and lighting through a hybrid lighting model. This model effectively represents typical outdoor lighting by employing a spherical Gaussian function to capture the directional, high-frequency components of sunlight, while learning a radiance transfer function via Spherical Harmonic coefficients to model the remaining low-frequency skylight comprehensively. Both quantitative metrics and qualitative comparisons demonstrate that ROSGS achieves state-of-the-art performance in relighting outdoor scenes and highlight its ability to deliver superior relighting accuracy and rendering efficiency.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracing2024
- The Sky’s the Limit: Relightable Outdoor Scenes via a Sky-Pixel Constrained Illumination Prior and Outside-In Visibility2024
- SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Views2022
- NeRF for Outdoor Scene Relighting2022
- Self-supervised Outdoor Scene Relighting2020
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020
- Differentiable Volumetric Rendering: Learning Implicit 3D Representations Without 3D Supervision2020
- DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation2019
- Learning Implicit Fields for Generative Shape Modeling2019
- Occupancy Networks: Learning 3D Reconstruction in Function Space2019