Automated music video generation using emotion synchronization
Authors:
- 1 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 002594-002597
Abstract
In this paper, we present an automated music video generation framework that utilizes emotion synchronization between video and music. After a user uploads a video or music, the framework segments the video and music, and then predicts the emotion of each of the segments. The preprocessing result is stored on the server's database. The user can select a set of videos and music from the database, and the framework will generate a music video. The system finds the most closely associated video segment with the music segment by comparing certain low level features and the emotion differences. We compare our work to a similar music video generation method by performing a user preference study, and show that our method generates a preferable result.Keywords
This publication has 7 references indexed in Scilit:
- LIRIS-ACCEDE: A Video Database for Affective Content AnalysisIEEE Transactions on Affective Computing, 2015
- 1000 songs for emotional analysis of music2013
- Multimedia and Signal Processing2012
- Automated music video generation using multi-level feature-based segmentationMultimedia Tools and Applications, 2008
- Automatic audio segmentation using a measure of audio novelty2002
- Automatic Extraction of Tempo and Beat From Expressive PerformancesJournal of New Music Research, 2001
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996