A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation

Authors:
Publisher website
Google Scholar
Abstract
In the context of novel view synthesis, 3D Gaussian Splatting (3DGS) has recently emerged as an efficient and competitive counterpart to Neural Radiance Field (NeRF), enabling high-fidelity photorealistic rendering in real time. Beyond novel view synthesis, the explicit and compact nature of 3DGS enables a wide range of downstream applications that require geometric and semantic understanding. This survey provides a comprehensive overview of recent progress in 3DGS applications. It first reviews the reconstruction preliminaries of 3DGS, followed by the problem formulation, 2D foundation models, and related NeRF-based research areas that inform downstream 3DGS applications. We then categorize 3DGS applications into three foundational tasks: segmentation, editing, and generation, alongside additional functional applications built upon or tightly coupled with these foundational capabilities. For each, we summarize representative methods, supervision strategies, and learning paradigms, highlighting shared design principles and emerging trends. Commonly used datasets and evaluation protocols are also summarized, along with a comparative analysis of recent methods across public benchmarks. To support ongoing research and development, a continually updated repository of papers, code, and resources is maintained at https://github.com/heshuting555/Awesome-3DGS-Applications.
Funding Information
  • National Natural Science Foundation of China (62472104)
  • Natural Science Foundation of Shanghai (25ZR1402138)
  • Shanghai Pujiang Programme (24PJD030)
  • European Union’s Horizon 2024 Research and Innovation Programme for the Marie Skłodowska-Curie Actions (101211118)

This publication has 251 references indexed in Scilit: