Implicit Neural Representation for Physics-driven Actuated Soft Bodies
Preprint
Abstract
Active soft bodies can affect their shape through an internal actuation mechanism that induces a deformation. Similar to recent work, this paper utilizes a differentiable, quasi-static, and physics-based simulation layer to optimize for actuation signals parameterized by neural networks. Our key contribution is a general and implicit formulation to control active soft bodies by defining a function that enables a continuous mapping from a spatial point in the material space to the actuation value. This property allows us to capture the signal's dominant frequencies, making the method discretization agnostic and widely applicable. We extend our implicit model to mandible kinematics for the particular case of facial animation and show that we can reliably reproduce facial expressions captured with high-quality capture systems. We apply the method to volumetric soft bodies, human poses, and facial expressions, demonstrating artist-friendly properties, such as simple control over the latent space and resolution invariance at test time.Keywords
All Related Versions
- Version 1, 2024-01-26, ArXiv
- Published version: ACM Transactions on Graphics, 41 (4), 1.
This publication has 30 references indexed in Scilit:
- StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generation2022
- Design and Control of Soft Robots Using Differentiable SimulationCurrent Robotics Reports, 2021
- Primal/Dual Descent Methods for DynamicsComputer Graphics Forum, 2020
- Semantic Deep Face Models2020
- Learning Formation of Physically-Based Face Attributes2020
- SoftSMPL: Data‐driven Modeling of Nonlinear Soft‐tissue Dynamics for Parametric HumansComputer Graphics Forum, 2020
- ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics2019
- Latent‐space Dynamics for Reduced Deformable SimulationComputer Graphics Forum, 2019
- Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization2017
- Recent Advances in Facial Appearance CaptureComputer Graphics Forum, 2015