A causal convolutional neural network for multi-subject motion modeling and generation
Open Access
- 1 February 2024
- journal article
- research article
- Published by Tsinghua University Press in Computational Visual Media
- Vol. 10 (1) , 45-59
Abstract
Inspired by the success of WaveNet in multi-subject speech synthesis, we propose a novel neural network based on causal convolutions for multi-subject motion modeling and generation. The network can capture the intrinsic characteristics of the motion of different subjects, such as the influence of skeleton scale variation on motion style. Moreover, after fine-tuning the network using a small motion dataset for a novel skeleton that is not included in the training dataset, it is able to synthesize high-quality motions with a personalized style for the novel skeleton. The experimental results demonstrate that our network can model the intrinsic characteristics of motions well and can be applied to various motion modeling and synthesis tasks.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- Phase-functioned neural networks for character controlACM Transactions on Graphics, 2017
- A Survey on Human Performance Capture and AnimationJournal of Computer Science and Technology, 2017
- A deep learning framework for character motion synthesis and editingACM Transactions on Graphics, 2016
- Recurrent Network Models for Human Dynamics2015
- Realtime style transfer for unlabeled heterogeneous human motionACM Transactions on Graphics, 2015
- 3D Human Motion Editing and Synthesis: A SurveyComputational and Mathematical Methods in Medicine, 2014
- Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural EnvironmentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Synthesis and editing of personalized stylistic human motion2010
- Style machines2000
- Practical Parameterization of Rotations Using the Exponential MapJournal of Graphics Tools, 1998