A Negative Emotion Recognition System with IoT-Based Multimodal Biosignal Data
Preprint
- 22 September 2023
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Previous studies to recognize negative emotions (e.g. disgust, fear, sadness) for mental health care have used heavy equipment directly attaching electroencephalogram (EEG) electrodes to the head, making it difficult to use in daily life, and they have proposed binary classification methods to determine whether negative emotion or not. To tackle this problem, we propose a negative emotion recognition system to collect multimodal biosignal data such as five EEG signals in an EEG headset and heart rate, galvanic skin response, and skin temperature in a smart band for classifying multiple negative emotions. It consists of android Internet of Things (IoT) application, an oneM2M-compliant IoT server, and a machine learning server. The android IoT application upload the biosignal data to the IoT server. By using the biosignal data stored in the IoT server, the machine learning server recognizes the negative emotions of disgust, fear, and sadness using a multi-class support vector machine (SVM) model with a radial basis function kernel (RBF). The experimental results showed that the multi-class SVM model achieved 93% accuracy when considering all the multimodal biosignal data. Moreover, when considering only data in the smart band, it could achieve 98% accuracy by optimizing the hyper-parameter of the RBF kernel.Keywords
All Related Versions
- Version 1, 2023-09-22, Preprints
- Published version: Electronics, 12 (20), 4321.
This publication has 25 references indexed in Scilit:
- A novel bagged tree ensemble regression method with multiple correlation coefficients to predict the train body vibrations using rail inspection dataMechanical Systems and Signal Processing, 2022
- Effect and feasibility of wearable physical activity trackers and pedometers for increasing physical activity and improving health outcomes in cancer survivors: A systematic review and meta-analysisJournal of Sport and Health Science, 2021
- Prediction of solar energy guided by pearson correlation using machine learningEnergy, 2021
- Emotion recognition by deeply learned multi-channel textual and EEG featuresFuture Generation Computer Systems, 2021
- Wearable technology and consumer interaction: A systematic review and research agendaComputers in Human Behavior, 2021
- Application of supervised machine learning paradigms in the prediction of petroleum reservoir properties: Comparative analysis of ANN and SVM modelsJournal of Petroleum Science and Engineering, 2021
- A comprehensive survey and taxonomy of the SVM-based intrusion detection systemsJournal of Network and Computer Applications, 2021
- Multi-channel EEG-based emotion recognition via a multi-level features guided capsule networkComputers in Biology and Medicine, 2020
- Drivers of helpfulness of online hotel reviews: A sentiment and emotion mining approachInternational Journal of Hospitality Management, 2020
- A machine learning model for emotion recognition from physiological signalsBiomedical Signal Processing and Control, 2020