PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics
Authors:
Top Cited Papers
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4389-4398
Abstract
We introduce PhysGaussian, a new method that seamlessly integrates physically grounded Newtonian dynamics within 3D Gaussians to achieve high-quality novel motion synthe-sis. Employing a custom Material Point Method (MPM), our approach enriches 3D Gaussian kernels with physically meaningful kinematic deformation and mechanical stress attributes, all evolved in line with continuum mechanics principles. A defining characteristic of our method is the seamless integration between physical simulation and visual rendering: both components utilize the same 3D Gaussian kernels as their discrete representations. This negates the necessity for triangle/tetrahedron meshing, marching cubes, “cage meshes,” or any other geometry embedding, highlighting the principle of “what you see is what you simulate (WS 2 ).” Our method demonstrates exceptional versatility across a wide variety of materials-including elastic entities, plastic metals, non-Newtonian fluids, and granular materials-showcasing its strong capabilities in creating diverse visual content with novel viewpoints and movements. Our project page is at: https://xpandora.github.io/PhysGaussian/Keywords
All Related Versions
Funding Information
- NSF (2301040,2008915,2244651,2008564,2153851,2023780)
This publication has 36 references indexed in Scilit:
- Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis2024
- Deforming Radiance Fields with Cages2022
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction2022
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields2022
- Point-NeRF: Point-based Neural Radiance Fields2022
- D-NeRF: Neural Radiance Fields for Dynamic Scenes2021
- Structure-from-Motion Revisited2016
- Nonlinear Continuum Mechanics for Finite Element Analysis2008
- The motion of a fluid ellipsoid in a general linear background flowJournal of Fluid Mechanics, 2003
- Ellipsoidal figures of equilibrium—an historical accountCommunications on Pure and Applied Mathematics, 1967