Genre-Adaptive Semantic Computing and Audio-Based Modelling for Music Mood Annotation
- 30 July 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 7 (2) , 122-135
Abstract
This study investigates whether taking genre into account is beneficial for automatic music mood annotation in terms of core affects valence, arousal, and tension, as well as several other mood scales. Novel techniques employing genre-adaptive semantic computing and audio-based modelling are proposed. A technique called the ACTwg employs genre-adaptive semantic computing of mood-related social tags, whereas ACTwg-SLPwg combines semantic computing and audio-based modelling, both in a genre-adaptive manner. The proposed techniques are experimentally evaluated at predicting listener ratings related to a set of 600 popular music tracks spanning multiple genres. The results show that ACTwg outperforms a semantic computing technique that does not exploit genre information, and ACTwg-SLPwg outperforms conventional techniques and other genre-adaptive alternatives. In particular, improvements in the prediction rates are obtained for the valence dimension which is typically the most challenging core affect dimension for audio-based annotation. The specificity of genre categories is not crucial for the performance of ACTwg-SLPwg. The study also presents analytical insights into inferring a concise tag-based genre representation for genre-adaptive music mood analysis.Keywords
Funding Information
- Research Council of Finland
- EPSRC Programme
- Fusing Semantic and Audio Technologies for Intelligent Music Production and Consumption (EP/L019981/1)
This publication has 45 references indexed in Scilit:
- Machine Recognition of Music EmotionACM Transactions on Intelligent Systems and Technology, 2012
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- The structure of musical preferences: A five-factor model.Journal of Personality and Social Psychology, 2011
- ‘Mister D.J., Cheer Me Up!’:Musical and Textual Features for Automatic Mood ClassificationJournal of New Music Research, 2010
- From the functions of music to music preferencePsychology of Music, 2009
- Autotagger: A Model for Predicting Social Tags from Acoustic Features on Large Music DatabasesJournal of New Music Research, 2008
- Adolescents' music preferences and personality characteristicsEuropean Journal of Personality, 2008
- Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant.Journal of Personality and Social Psychology, 1999
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980