Multi-modal analysis of dance performances for music-driven choreography synthesis
- 1 March 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 2466-2469
Abstract
We propose a framework for modeling, analysis, annotation and synthesis of multi-modal dance performances. We analyze correlations between music features and dance figure labels on training dance videos in order to construct a mapping from music measures (segments) to dance figures towards generating music-driven dance choreographies. We assume that dance figure segment boundaries coincide with music measures (audio boundaries). For each training video, figure segments are manually labeled by an expert to indicate the type of dance motion. Chroma features of each measure are used for music analysis. We model temporal statistics of such chroma features corresponding to each dance figure label to identify different rhythmic patterns for that dance motion. The correlations between dance figures and music measures, as well as, correlations between consecutive dance figures are used to construct a mapping for music-driven dance choreography synthesis. Experimental results demonstrate the success of proposed music-driven choreography synthesis framework.Keywords
This publication has 8 references indexed in Scilit:
- An audio-driven dancing avatarJournal on Multimodal User Interfaces, 2008
- Multicamera Audio-Visual Analysis of Dance Figures2007
- Beat Tracking by Dynamic ProgrammingJournal of New Music Research, 2007
- Evaluation of Audio Beat Tracking and Music Tempo Extraction AlgorithmsJournal of New Music Research, 2007
- Context-Dependent Beat Tracking of Musical AudioIEEE Transactions on Audio, Speech, and Language Processing, 2007
- Detecting dance motion structure through music analysis2004
- Three learning systems in the reconnaissance of basic movements in contemporary dance2003
- Motion textureACM Transactions on Graphics, 2002