VRSplat: Fast and Robust Gaussian Splatting for Virtual Reality
Top Cited Papers
Open Access
- 22 May 2025
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Vol. 8 (1) , 1-22
Abstract
3D Gaussian Splatting (3DGS) has rapidly become a leading technique for novel-view synthesis, providing exceptional performance through efficient software-based GPU rasterization. Its versatility enables real-time applications, including on mobile and lower-powered devices. However, 3DGS faces key challenges in virtual reality (VR): (1) temporal artifacts, such as popping during head movements, (2) projection-based distortions that result in disturbing and view-inconsistent floaters, and (3) reduced framerates when rendering large numbers of Gaussians, falling below the critical threshold for VR. Compared to desktop environments, these issues are drastically amplified by large field-of-view, constant head movements, and high resolution of head-mounted displays (HMDs). In this work, we introduce VRSplat: we combine and extend several recent advancements in 3DGS to address challenges of VR holistically. We show how the ideas of Mini-Splatting, StopThePop, and Optimal Projection can complement each other, by modifying the individual techniques and core 3DGS rasterizer. Additionally, we propose an efficient foveated rasterizer that handles focus and peripheral areas in a single GPU launch, avoiding redundant computations and improving GPU utilization. Our method also incorporates a fine-tuning step that optimizes Gaussian parameters based on StopThePop depth evaluations and Optimal Projection. We validate our method through a controlled user study with 25 participants, showing a strong preference for VRSplat over other configurations of Mini-Splatting. VRSplat is the first, systematically evaluated 3DGS approach capable of supporting modern VR applications, achieving 72+ FPS while eliminating popping and stereo-disrupting floaters.Keywords
Funding Information
- Austrian Science Fund (10.55776/I6663)
This publication has 36 references indexed in Scilit:
- Mini-Splatting: Representing Scenes with a Constrained Number of Gaussians2024
- LAENeRF: Local Appearance Editing for Neural Radiance Fields2024
- Mip-Splatting: Alias-Free 3D Gaussian Splatting2024
- VastGaussian: Vast 3D Gaussians for Large Scene Reconstruction2024
- Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization2023
- Plenoxels: Radiance Fields without Neural Networks2022
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields2022
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- Towards a Quality Metric for Dense Light Fields2017