360-GS: Layout-Guided Panoramic Gaussian Splatting for Indoor Roaming
Authors:
Top Cited Papers
- 25 March 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1042-1053
Abstract
3D Gaussian Splatting (3D-GS) has recently attracted great attention with real-time and photo-realistic renderings. This technique typically takes perspective images as input and optimizes a set of 3D elliptical Gaussians by splatting them onto the image planes, resulting in $2 D$ Gaussians. However, applying 3D-GS to panoramic inputs presents challenges in effectively modeling the projection onto the spherical surface of 360° images using 2D Gaussians. In practical applications, input panoramas are often sparse, leading to unreliable initialization of 3D Gaussians and subsequent degradation of 3D-GS quality. In addition, due to the under-constrained geometry of texture-less planes (e.g., walls and floors), 3D-GS struggles to model these flat regions with elliptical Gaussians, resulting in significant floaters in novel views. To address these issues, we propose 360-GS, a novel layout-guided 360° Gaussian splatting for a limited set of panoramic inputs. Instead of splatting 3D Gaussians directly onto the spherical surface, 360-GS projects them onto the tangent plane of the unit sphere and then maps them to the spherical projections.
Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategy2024
- AtlantaNet: Inferring the 3D Indoor Layout from a Single $360^\circ $ Image Beyond the Manhattan World Assumption2020
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020
- Learning Free-Form Deformations for 3D Object Reconstruction2019
- HorizonNet: Learning Room Layout With 1D Representation and Pano Stretch Data Augmentation2019
- DeepVoxels: Learning Persistent 3D Feature Embeddings2019
- Matterport3D: Learning from RGB-D Data in Indoor Environments2017
- IM2CAD2017
- Pixelwise View Selection for Unstructured Multi-View Stereo2016
- Structure-from-Motion Revisited2016