Computational emotion recognition using multimodal physiological signals: Elicited using Japanese kanji words
Authors:
- 1 July 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 615-620
Abstract
This paper investigates computational emotion recognition using multimodal physiological signals. Four physiological signs - plethysmogram, skin conductance change, respiration rate and skin temperature - are measured to evaluate three emotions: positive, negative and neutral. Psychophysical experiments are conducted using Japanese kanji words in order to excite emotions in subjects so as to elicit physiological signals. For computational emotion recognition, machine-learning approaches, such as multilayer neural networks, support vector machines, decision trees and random forests, are used to design emotion recognition systems and their characteristics are investigated. In computational experiments conducted for recognising emotions, support vector machines equipped with a Gaussian kernel function attain a maximum averaged recognition rate of around 40% for all three emotions and around 56% for two emotions (positive and negative). The results obtained in this study shows that using multimodal physiological signals with a machine-learning approach is feasible and suited for computational emotion recognition.Keywords
This publication has 15 references indexed in Scilit:
- Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor2011
- Remarks on computational emotion recognition from vital information2009
- Emotion Recognition for hHman-Machine Communication2008
- Multimodal human–computer interaction: A surveyComputer Vision and Image Understanding, 2007
- Why Some Emotional States Are Easier to be Recognized Than Others: A thorough data analysis and a very accurate rough set classifier2006
- 'Affective' computing and emotion recognition systems2005
- Affective computing: problems, reactions and intentionsInteracting with Computers, 2004
- A feeling estimation system using a simple electroencephalograph2004
- Comparison of Emotion Recognition Methods from Bio-Potential SignalsThe Japanese Journal of Ergonomics, 2004
- A circumplex model of affect.Journal of Personality and Social Psychology, 1980