What Strikes the Strings of Your Heart?–Multi-Label Dimensionality Reduction for Music Emotion Analysis via Brain Imaging
- 4 May 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Autonomous Mental Development
- Vol. 7 (3) , 176-188
Abstract
After 20 years of extensive study in psychology, some musical factors have been identified that can evoke certain kinds of emotions. However, the underlying mechanism of the relationship between music and emotion remains unanswered. This paper intends to find the genuine correlates of music emotion by exploring a systematic and quantitative framework. The task is formulated as a dimensionality reduction problem, which seeks the complete and compact feature set with intrinsic correlates for the given objectives. Since a song generally elicits more than one emotion, we explore dimensionality reduction techniques for multi-label classification. One challenging problem is that the hard label cannot represent the extent of the emotion and it is also difficult to ask the subjects to quantize their feelings. This work tries utilizing the electroencephalography (EEG) signal to solve this challenge. A learning scheme called EEG-based emotion smoothing ( E 2 S) and a bilinear multi-emotion similarity preserving embedding (BME-SPE) algorithm are proposed. We validate the effectiveness of the proposed framework on standard dataset CAL-500. Several influential correlates have been identified and the classification via those correlates has achieved good performance. We build a Chinese music dataset according to the identified correlates and find that the music from different cultures may share similar emotions.Keywords
This publication has 55 references indexed in Scilit:
- An Iterative Framework for EEG-based Image Search: Robust Retrieval with Weak ClassifiersPLOS ONE, 2013
- Machine Recognition of Music EmotionACM Transactions on Intelligent Systems and Technology, 2012
- Multilabel dimensionality reduction via dependence maximizationACM Transactions on Knowledge Discovery From Data, 2010
- Emotional responses to music: The need to consider underlying mechanismsBehavioral and Brain Sciences, 2008
- Modelling the relationships between emotional responses to, and musical content of, music therapy improvisationsPsychology of Music, 2007
- ML-KNN: A lazy learning approach to multi-label learningPattern Recognition, 2007
- Music and the BrainScientific American, 2004
- Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotionsCognition and Emotion, 2001
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980
- The Affective Character of the Major and Minor Modes in MusicThe American Journal of Psychology, 1935