Machine Learning–based Modeling and Prediction of the Intrinsic Relationship between Human Emotion and Music
Open Access
- 31 July 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Applied Perception
- Vol. 19 (3) , 1-12
Abstract
Human emotion is one of the most complex psychophysiological phenomena and has been reported to be affected significantly by music listening. It is supposed that there is an intrinsic relationship between human emotion and music, which can be modeled and predicted quantitatively in a supervised manner. Here, a heuristic clustering analysis is carried out on large-scale free music archive to derive a genre-diverse music library, to which the emotional response of participants is measured using a standard protocol, consequently resulting in a systematic emotion-to-music profile. Eight machine learning methods are employed to statistically correlate the basic sound features of music audio tracks in the library with the measured emotional response of tested people to the music tracks in a training set and to blindly predict the emotional response from sound features in a test set. This study found that nonlinear methods are more robust and predictable but considerably more time-consuming than linear approaches. The neural networks have strong internal fittability but are associated with a significant overfitting issue. The support vector machine and Gaussian process exhibit both high internal stability and satisfactory external predictability in all used methods; they are considered as promising tools to model, predict, and explain the intrinsic relationship between human emotion and music. The psychological basis and perceptional implication underlying the built machine learning models are also discussed to find out the key music factors that affect human emotion.Keywords
Funding Information
- Sichuan Social Science Planning (SC22B167)
- ShuDi Music Institute of Chengdu Normal University
This publication has 37 references indexed in Scilit:
- Serotonin and emotion, learning and memoryReviews in the Neurosciences, 2012
- Dopamine release during human emotional processingNeuroImage, 2009
- How Does Music Arouse “Chills”?Annals of the New York Academy of Sciences, 2005
- Investigating Emotion with MusicAnnals of the New York Academy of Sciences, 2005
- Random Forest: A Classification and Regression Tool for Compound Classification and QSAR ModelingJournal of Chemical Information and Computer Sciences, 2003
- Quantitative Structure−Activity Relationship Studies Using Gaussian ProcessesJournal of Chemical Information and Computer Sciences, 2001
- Bayesian CART Model SearchJournal of the American Statistical Association, 1998
- Support-vector networksMachine Learning, 1995
- Universal Approximation Using Radial-Basis-Function NetworksNeural Computation, 1991
- Partial least-squares regression: a tutorialAnalytica Chimica Acta, 1986