Facial geometric feature extraction based emotional expression classification using machine learning algorithms
Open Access
- 18 February 2021
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 16 (2) , e0247131
Abstract
Emotion plays a significant role in interpersonal communication and also improving social life. In recent years, facial emotion recognition is highly adopted in developing human-computer interfaces (HCI) and humanoid robots. In this work, a triangulation method for extracting a novel set of geometric features is proposed to classify six emotional expressions (sadness, anger, fear, surprise, disgust, and happiness) using computer-generated markers. The subject’s face is recognized by using Haar-like features. A mathematical model has been applied to positions of eight virtual markers in a defined location on the subject’s face in an automated way. Five triangles are formed by manipulating eight markers’ positions as an edge of each triangle. Later, these eight markers are uninterruptedly tracked by Lucas- Kanade optical flow algorithm while subjects’ articulating facial expressions. The movement of the markers during facial expression directly changes the property of each triangle. The area of the triangle (AoT), Inscribed circle circumference (ICC), and the Inscribed circle area of a triangle (ICAT) are extracted as features to classify the facial emotions. These features are used to distinguish six different facial emotions using various types of machine learning algorithms. The inscribed circle area of the triangle (ICAT) feature gives a maximum mean classification rate of 98.17% using a Random Forest (RF) classifier compared to other features and classifiers in distinguishing emotional expressions.Keywords
Funding Information
- Kuwait Foundation for the Advancement of Sciences (PR18-18EE-01)
This publication has 40 references indexed in Scilit:
- Age-Invariant Face Recognition Using Triangle Geometric FeaturesInternational Journal of Pattern Recognition and Artificial Intelligence, 2015
- Emotion Recognition using Fuzzy Rule- based SystemInternational Journal of Computer Applications, 2014
- Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector MachinesSensors, 2013
- Facial expression recognition based on geometric and optical flow features in colour image sequencesIET Computer Vision, 2012
- Local binary patterns for multi-view facial expression recognitionComputer Vision and Image Understanding, 2011
- Emotion Recognition through Physiological Signals for Human-Machine Communication2010
- Dense image registration through MRFs and efficient linear programmingMedical Image Analysis, 2008
- An empirical study of machine learning techniques for affect recognition in human–robot interactionPattern Analysis and Applications, 2006
- Real time facial expression recognition in video using support vector machines2003
- Facial signs of emotional experience.Journal of Personality and Social Psychology, 1980