Learning Nonlinear Soft-Tissue Dynamics for Interactive Avatars
Authors:
Open Access
- 25 July 2018
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Vol. 1 (1) , 1-15
Abstract
We present a novel method to enrich existing vertex-based human body models by adding soft-tissue dynamics. Our model learns to predict per-vertex 3D offsets, referred to as dynamic blendshapes, that reproduce nonlinear mesh deformation effects as a function of pose information. This enables the synthesis of realistic 3D mesh animations, including soft-tissue effects, using just skeletal motion. At the core of our method there is a neural network regressor trained on high-quality 4D scans from which we extract pose, shape and soft-tissue information. Our regressor uses a novel nonlinear subspace, which we build using an autoencoder, to efficiently compact soft-tissue dynamics information. Once trained, our method can be plugged to existing vertex-based skinning methods with little computational overhead (<10ms), enabling real-time nonlinear dynamics. We qualitatively and quantitatively evaluate our method, and show compelling animations with soft-tissue effects, created using publicly available motion capture datasets.Keywords
This publication has 45 references indexed in Scilit:
- Stretchable and Twistable Bones for Skeletal Shape DeformationACM Transactions on Graphics, 2011
- Stable spaces for real-time clothingACM Transactions on Graphics, 2010
- A Statistical Model of Human Pose and Body ShapeComputer Graphics Forum, 2009
- Geometric skinning with approximate dual quaternion blendingACM Transactions on Graphics, 2008
- SCAPEACM Transactions on Graphics, 2005
- Skinning mesh animationsACM Transactions on Graphics, 2005
- Real-Time subspace integration for St. Venant-Kirchhoff deformable modelsACM Transactions on Graphics, 2005
- Automatic determination of facial muscle activations from sparse motion capture marker dataACM Transactions on Graphics, 2005
- Articulated body deformation from range scan dataACM Transactions on Graphics, 2002
- Interactive skeleton-driven dynamic deformationsACM Transactions on Graphics, 2002