Harnessing Wearable Devices for Emotional Intelligence: Therapeutic Applications in Digital Health
Open Access
Abstract
Emotional intelligence strives to bridge the gap between human and machine interactions. The application of such systems varies and is becoming more prominent as healthcare services seek to provide more efficient care by utilizing smart digital health apps. One application in digital health is the incorporation of emotion recognition systems as a tool for therapeutic interventions. To this end, a system is designed to collect and analyze physiological signal data, such as electrodermal activity (EDA) and electrocardiogram (ECG), from smart wearable devices. The data are collected from different subjects of varying ages taking part in a study on emotion induction methods. The obtained signals are processed to identify stimulus trigger instances and classify the different reaction stages, as well as arousal strength, using signal processing and machine learning techniques. The reaction stages are identified using a support vector machine algorithm, while the arousal strength is classified using the ResNet50 network architecture. The findings indicate that the EDA signal effectively identifies the emotional trigger, registering a root mean squared error (RMSE) of 0.9871. The features collected from the ECG signal show efficient emotion detection with 94.19% accuracy. However, arousal strength classification is only able to reach 60.37% accuracy on the given dataset. The proposed system effectively detects emotional reactions and can categorize their arousal strength in response to specific stimuli. Such a system could be integrated into therapeutic settings to monitor patients’ emotional responses during therapy sessions. This real-time feedback can guide therapists in adjusting their strategies or interventions.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (CoHMed/PersonaMed-A 13FH5I06IA, LESSON FKZ: 3FH5E10IA, KOMPASS, FKZ 2523FSB110, AIDE-ASD FKZ 57656657)
- Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg (CoHMed/PersonaMed-A 13FH5I06IA, LESSON FKZ: 3FH5E10IA, KOMPASS, FKZ 2523FSB110, AIDE-ASD FKZ 57656657)
- ERAPERMED2022-276—ETAP BMG (CoHMed/PersonaMed-A 13FH5I06IA, LESSON FKZ: 3FH5E10IA, KOMPASS, FKZ 2523FSB110, AIDE-ASD FKZ 57656657)
- Deutscher Akademischer Austauschdienst (CoHMed/PersonaMed-A 13FH5I06IA, LESSON FKZ: 3FH5E10IA, KOMPASS, FKZ 2523FSB110, AIDE-ASD FKZ 57656657)
This publication has 44 references indexed in Scilit:
- Emotion recognition based on customized smart bracelet with built-in accelerometerPeerJ, 2016
- Going deeper with convolutions2015
- Reliability of Ultra-Short-Term Analysis as a Surrogate of Standard 5-Min Analysis of Heart Rate VariabilityTelemedicine and e-Health, 2015
- DEAP: A Database for Emotion Analysis ;Using Physiological SignalsIEEE Transactions on Affective Computing, 2011
- The Pediatrician's Role in the Diagnosis and Management of Autistic Spectrum Disorder in ChildrenPediatrics, 2001
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994
- The ECG and the single channelJournal of Electrocardiology, 1991
- Percentage Points for a Generalized ESD Many-Outlier ProcedureTechnometrics, 1983
- Least-squares frequency analysis of unequally spaced dataAstrophysics and Space Science, 1976
- A New Method of Interpolation and Smooth Curve Fitting Based on Local ProceduresJournal of the ACM, 1970