A Multimodal Music Recommendation System with Listeners' Personality and Physiological Signals
Authors:
Open Access
- 1 August 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 357-360
Abstract
This preliminary study explored multiple information sources for music recommendation system (MRS), including users' personality traits measured by the Ten-Item Personality Inventory (TIPI) and physiological signals recorded by a wearable wristband. A dataset of 23 participants and 628 song listening records were obtained from a user experiment, with matched personality, physiological signals as well as music acoustic features. Based on the dataset, a machine learning experiment with four regression algorithms was conducted to compare recommendation performances across different combinations of feature sets. Results show that personality features contributed significantly to the improvement of recommender accuracy, while physiological features contributed less. Analysis of top features in the best performing model revealed the importance of some physiological features. Future studies are called for to further investigate multimodal MRS through exploiting user properties and context data.Keywords
Funding Information
- National Natural Science Foundation of China (61703357)
- Research Grant Council in Hong Kong (HKU 17607018)
This publication has 16 references indexed in Scilit:
- Convolutional Recurrent Neural Networks for Polyphonic Sound Event DetectionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2017
- Cross-Dataset and Cross-Cultural Music Mood Prediction: A Case on Western and Chinese Pop SongsIEEE Transactions on Affective Computing, 2017
- Evaluation of CDA and CvxEDA Models2016
- A framework for evaluating multimodal music mood classificationJournal of the Association for Information Science and Technology, 2016
- A personalized music recommendation system based on electroencephalography feedbackMultimedia Tools and Applications, 2016
- The neglected user in music information retrieval researchJournal of Intelligent Information Systems, 2013
- Introduction to Recommender Systems Handbook2010
- Heart Rate Variability as an Index of Regulated Emotional RespondingReview of General Psychology, 2006
- Emotion recognition system using short-term monitoring of physiological signalsMedical & Biological Engineering & Computing, 2004
- A very brief measure of the Big-Five personality domainsJournal of Research in Personality, 2003