A framework for evaluating multimodal music mood classification
- 13 January 2016
- journal article
- research article
- Published by Wiley in Journal of the Association for Information Science and Technology
- Vol. 68 (2) , 273-285
Abstract
This research proposes a framework for music mood classification that uses multiple and complementary information sources, namely, music audio, lyric text, and social tags associated with music pieces. This article presents the framework and a thorough evaluation of each of its components. Experimental results on a large data set of 18 mood categories show that combining lyrics and audio significantly outperformed systems using audio‐only features. Automatic feature selection techniques were further proved to have reduced feature space. In addition, the examination of learning curves shows that the hybrid systems using lyrics and audio needed fewer training samples and shorter audio clips to achieve the same or better classification accuracies than systems using lyrics or audio singularly. Last but not least, performance comparisons reveal the relative importance of audio and lyric features across mood categories.Keywords
Funding Information
- Andrew W. Mellon Foundation and a Seed Fund
- Basic Research in the University of Hong Kong
This publication has 31 references indexed in Scilit:
- Machine Recognition of Music EmotionACM Transactions on Intelligent Systems and Technology, 2012
- ‘Mister D.J., Cheer Me Up!’:Musical and Textual Features for Automatic Mood ClassificationJournal of New Music Research, 2010
- Determination of Nonprototypical Valence and Arousal in Popular Music: Features and PerformancesEURASIP Journal on Audio, Speech, and Music Processing, 2010
- An evaluation of text classification methods for literary studyLiterary and Linguistic Computing, 2008
- Opinion Mining and Sentiment AnalysisFoundations and Trends® in Information Retrieval, 2008
- The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval researchAcoustical Science and Technology, 2008
- Combining multiple classifiers by averaging or by multiplying?Pattern Recognition, 2000
- 10.1162/153244303322753670Applied Physics Letters, 2000
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980
- Experimental Studies of the Elements of Expression in MusicThe American Journal of Psychology, 1936