Portable Facial Expression System Based on EMG Sensors and Machine Learning Models
Open Access
Abstract
One of the biggest challenges of computers is collecting data from human behavior, such as interpreting human emotions. Traditionally, this process is carried out by computer vision or multichannel electroencephalograms. However, they comprise heavy computational resources, far from final users or where the dataset was made. On the other side, sensors can capture muscle reactions and respond on the spot, preserving information locally without using robust computers. Therefore, the research subject is the recognition of the six primary human emotions using electromyography sensors in a portable device. They are placed on specific facial muscles to detect happiness, anger, surprise, fear, sadness, and disgust. The experimental results showed that when working with the CortexM0 microcontroller, enough computational capabilities were achieved to store a deep learning model with a classification store of 92%. Furthermore, we demonstrate the necessity of collecting data from natural environments and how they need to be processed by a machine learning pipeline.Keywords
Funding Information
- Universidad de Las Américas (UDLA) (IEA.WHP.21.02)
This publication has 47 references indexed in Scilit:
- Emotional valence sensing using a wearable facial EMG deviceScientific Reports, 2021
- Assessment of Pain using Optimized Feature Set from Corrugator EMG2020
- EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks and Broad Learning System2018
- A Wearable High-Resolution Facial Electromyography for Long Term Recordings in Freely Behaving HumansScientific Reports, 2018
- Machine-learning approaches for recognizing muscle activities involved in facial expressions captured by multi-channels surface electromyogramSmart Health, 2018
- Multiresolution framework for emotion sensing in physiological signals2016
- Facial Expression Recognition with sEMG Method2015
- Automated facial coding: Validation of basic emotions and FACS AUs in FaceReader.Journal of Neuroscience, Psychology, and Economics, 2014
- Neuromuscular Junction Disorders2013
- Classifying facial actionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999