Geometry-Aware Retargeting for Two-Skinned Characters Interaction
Open Access
- 19 November 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (6) , 1-17
Abstract
Interactive motion between multiple characters is widely utilized in games and movies. However, the method for generating interactive motions considering the character's diverse mesh shape has yet to be studied. We propose a Spatio Cooperative Transformer (SCT) to retarget the interacting motions of two characters having arbitrary mesh connectivity. SCT predicts the residual of root position and joint rotations considering the shape difference between the source and target of interacting characters. In addition, we introduce an anchor loss function for SCT to maintain the geometric distance between the interacting characters when they are retargeted. We also propose a motion augmentation method with deformation-based adaptation to prepare a source-target paired dataset with an identical mesh connectivity for training. In experiments, our method achieved higher accuracy for semantic preservation and produced less artifacts of inter-penetration between the interacting characters for unseen characters and motions than the baselines. Moreover, we conducted a user evaluation using characters with various shapes, spanning low-to-high interaction levels to prove better semantic preservation of our method compared to previous studies.Keywords
Funding Information
- National Research Foundation of Kore (RS-2024-00333478)
This publication has 22 references indexed in Scilit:
- REMOS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions2024
- Semantics-Aware Motion Retargeting with Vision-Language Models2024
- Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry2023
- Interaction-Based Human Activity ComparisonIEEE Transactions on Visualization and Computer Graphics, 2019
- Recovering Accurate 3D Human Pose in the Wild Using IMUs and a Moving Camera2018
- Retargeting Human-Object Interaction to Virtual AvatarsIEEE Transactions on Visualization and Computer Graphics, 2016
- Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural EnvironmentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Motion adaptation for humanoid robots in constrained environments2013
- Motion adaptation based on character shapeComputer Animation and Virtual Worlds, 2008
- On-line motion retargetting1999