Multicultural Facial Expression Recognition Based on Differences of Western-Caucasian and East-Asian Facial Expressions of Emotions
Open Access
- 1 May 2018
- journal article
- conference paper
- Published by Institute of Electronics, Information and Communications Engineers (IEICE) in IEICE Transactions on Information and Systems
- Vol. E101.D (5) , 1317-1324
Abstract
An increasing number of psychological studies have demonstrated that the six basic expressions of emotions are not culturally universal. However, automatic facial expression recognition (FER) systems disregard these findings and assume that facial expressions are universally expressed and recognized across different cultures. Therefore, this paper presents an analysis of Western-Caucasian and East-Asian facial expressions of emotions based on visual representations and cross-cultural FER. The visual analysis builds on the Eigenfaces method, and the cross-cultural FER combines appearance and geometric features by extracting Local Fourier Coefficients (LFC) and Facial Fourier Descriptors (FFD) respectively. Furthermore, two possible solutions for FER under multicultural environments are proposed. These are based on an early race detection, and independent models for culture-specific facial expressions found by the analysis evaluation. HSV color quantization combined with LFC and FFD compose the feature extraction for race detection, whereas culture-independent models of anger, disgust and fear are analyzed for the second solution. All tests were performed using Support Vector Machines (SVM) for classification and evaluated using five standard databases. Experimental results show that both solutions overcome the accuracy of FER systems under multicultural environments. However, the approach which individually considers the culture-specific facial expressions achieved the highest recognition rate.Keywords
This publication has 16 references indexed in Scilit:
- Effects of cultural characteristics on building an emotion classifier through facial expression analysisJournal of Electronic Imaging, 2015
- Learning Race from Face: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- An Effective Visual Descriptor Based on Color and Shape Features for Image Retrieval2014
- Culture and facial expressions of emotionVisual Cognition, 2013
- Facial expressions of emotion are not culturally universalProceedings of the National Academy of Sciences, 2012
- Facial Expression Recognition2011
- Evidence and a computational explanation of cultural differences in facial expression recognition.Emotion, 2010
- A survey of skin-color modeling and detection methodsPattern Recognition, 2007
- Coding facial expressions with Gabor wavelets2002
- An argument for basic emotionsCognition and Emotion, 1992