Dancing‐to‐Music Character Animation
Authors:
- 1 September 2006
- journal article
- Published by Wiley in Computer Graphics Forum
- Vol. 25 (3) , 449-458
Abstract
In computer graphics, considerable research has been conducted on realistic human motion synthesis. However, most research does not consider human emotional aspects, which often strongly affect human motion. This paper presents a new approach for synthesizing dance performance matched to input music, based on the emotional aspects of dance performance. Our method consists of a motion analysis, a music analysis, and a motion synthesis based on the extracted features. In the analysis steps, motion and music feature vectors are acquired. Motion vectors are derived from motion rhythm and intensity, while music vectors are derived from musical rhythm, structure, and intensity. For synthesizing dance performance, we first find candidate motion segments whose rhythm features are matched to those of each music segment, and then we find the motion segment set whose intensity is similar to that of music segments. Additionally, our system supports having animators control the synthesis process by assigning desired motion segments to the specified music segments. The experimental results indicate that our method actually creates dance performance as if a character was listening and expressively dancing to the music. Categories and Subject Descriptors (according to ACM CCS): I.3.7 [Computer Graphics]: Three‐Dimensional Graphics and Realism Animation; J.5 [Arts and Humanities]: Performing Arts MusicKeywords
This publication has 29 references indexed in Scilit:
- Efficient content-based retrieval of motion capture dataACM Transactions on Graphics, 2005
- Style translation for human motionACM Transactions on Graphics, 2005
- Style-based inverse kinematicsACM Transactions on Graphics, 2004
- Speaking with handsACM Transactions on Graphics, 2004
- Synthesizing animations of human manipulation tasksACM Transactions on Graphics, 2004
- Rhythmic-motion synthesis based on motion-beat analysisACM Transactions on Graphics, 2003
- Interactive control of avatars animated with human motion dataACM Transactions on Graphics, 2002
- Motion textureACM Transactions on Graphics, 2002
- The auditory “Primal Sketch”: A multiscale model of rhythmic groupingJournal of New Music Research, 1994
- Calculation of a constant Q spectral transformThe Journal of the Acoustical Society of America, 1991