Digs: diffusion-guided Gaussian Splatting for dynamic occlusion surgical scene reconstruction
- 30 January 2026
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 21 (4) , 781-792
Abstract
Purpose: Accurate 3D reconstruction from endoscopic videos is crucial for advancing computer-assisted minimally invasive surgery. However, existing approaches struggle with dynamic surgical scenes where instrument occlusions cause significant reconstruction artifacts. Although 3D Gaussian Splatting (3DGS) enables rapid reconstruction, it often suffers from incomplete surface recovery due to occlusion-induced missing regions and error propagation from suboptimal initial point clouds during radiance field optimization. This study aims to enhance reconstruction accuracy in dynamically occluded surgical environments. Methods: We propose a diffusion-guided Gaussian Splatting (DiGS) framework comprising two key components: (1) a diffusion-guided surface completion network that incorporates surgical scene priors to restore high-fidelity textures in occluded regions, improving surface completeness; and (2) a lightweight annealed smoothing mechanism designed to mitigate endoscope motion estimation errors, ensuring temporal coherence during continuous frame interpolation and stabilizing radiance field optimization. Results: Extensive experiments on the EndoNeRF and StereoMIS datasets demonstrate the superiority of DiGS over state-of-the-art baselines. On EndoNeRF, DiGS achieves a 61.75% improvement in LPIPS, indicating stronger perceptual alignment in dynamically occluded scenes. On StereoMIS, DiGS delivers an 7.03% PSNR gain and a 40.79% LPIPS improvement, along with consistently higher SSIM scores confirming superior preservation of structural details. Conclusion: The proposed DiGS framework effectively addresses the challenges of dynamic occlusions and motion-induced errors in surgical scene reconstruction, producing more accurate and temporally coherent 3D models. The code is publicly available at https://github.com/IGSResearch/DiGS.Keywords
Funding Information
- Science and Technology Planning Project of Guangdong Province (2024A0505040020)
- Shenzhen Medical Research Fund (D2402006)
- Shenzhen Science and Technology Innovation Program (JCYJ20220531100614032)
- Shenzhen Municipal Key Laboratory of Neuropsychiatric Modulation, Chinese Academy of Sciences (SZIIT2025KJ012, SZIIT2025KJ016)
This publication has 35 references indexed in Scilit:
- EndoGS: Deformable Endoscopic Tissues Reconstruction with Gaussian Splatting2025
- SurgicalGaussian: Deformable 3D Gaussians for High-Fidelity Surgical Scene Reconstruction2024
- Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting2024
- EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Camera2024
- EndoSparse: Real-Time Sparse View Synthesis of Endoscopic Scenes using Gaussian Splatting2024
- Deform3DGS: Flexible Deformation for Fast Surgical Scene Reconstruction with Gaussian Splatting2024
- Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene Reconstruction2024
- EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videos2023
- Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery2022
- E-DSSR: Efficient Dynamic Surgical Scene Reconstruction with Transformer-Based Stereoscopic Depth Perception2021