Deep Deformation Detail Synthesis for Thin Shell Models
- 10 August 2023
- journal article
- research article
- Published by Wiley in Computer Graphics Forum
- Vol. 42 (5)
Abstract
In physics‐based cloth animation, rich folds and detailed wrinkles are achieved at the cost of expensive computational resources and huge labor tuning. Data‐driven techniques make efforts to reduce the computation significantly by utilizing a preprocessed database. One type of methods relies on human poses to synthesize fitted garments, but these methods cannot be applied to general cloth animations. Another type of methods adds details to the coarse meshes obtained through simulation, which does not have such restrictions. However, existing works usually utilize coordinate‐based representations which cannot cope with large‐scale deformation, and requires dense vertex correspondences between coarse and fine meshes. Moreover, as such methods only add details, they require coarse meshes to be sufficiently close to fine meshes, which can be either impossible, or require unrealistic constraints to be applied when generating fine meshes. To address these challenges, we develop a temporally and spatially as‐consistent‐as‐possible deformation representation (named TS‐ACAP) and design a DeformTransformer network to learn the mapping from low‐resolution meshes to ones with fine details. This TS‐ACAP representation is designed to ensure both spatial and temporal consistency for sequential large‐scale deformations from cloth animations. With this TS‐ACAP representation, our DeformTransformer network first utilizes two mesh‐based encoders to extract the coarse and fine features using shared convolutional kernels, respectively. To transduct the coarse features to the fine ones, we leverage the spatial and temporal Transformer network that consists of vertex‐level and frame‐level attention mechanisms to ensure detail enhancement and temporal coherence of the prediction. Experimental results show that our method is able to produce reliable and realistic animations in various datasets at high frame rates with superior detail synthesis abilities compared to existing methods.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (U21A20515, 62171321, 62162044, 62102414, 62061136007)
- Natural Science Foundation of Beijing Municipality (JQ21013)
- H2020 LEIT Information and Communication Technologies
- Center for Africana Studies, Johns Hopkins University (E361090)
This publication has 59 references indexed in Scilit:
- Physics-inspired upsampling for cloth simulation in gamesACM Transactions on Graphics, 2011
- Stable spaces for real-time clothingACM Transactions on Graphics, 2010
- A deformation transformer for real-time cloth animationACM Transactions on Graphics, 2010
- Example-based wrinkle synthesis for clothing animationACM Transactions on Graphics, 2010
- Mixed-integer quadrangulationACM Transactions on Graphics, 2009
- Asynchronous contact mechanicsACM Transactions on Graphics, 2009
- Long Short-Term MemoryNeural Computation, 1997
- Collision and self-collision handling in cloth model dedicated to design garments1997
- Collision and Self-Collision Detection: Efficient and Robust Solutions for Highly Deformable Surfaces1995
- Elastically deformable modelsACM SIGGRAPH Computer Graphics, 1987