IoT-Driven Facial Expression Recognition for Personalized Healthcare in Industry 5.0
Authors:
- Shehzad AliSAShehzad Ali
- Muhammad SajjadMSMuhammad Sajjad
- Ik Hyun LeeILIk Hyun Lee
- Faouzi Alaya CheikhFaouzi Alaya Cheikh
- Athena Cristina RibiganARAthena Cristina Ribigan
- Ludovico PedullàLPLudovico Pedullà
- Nikolaos PapagiannakisNikolaos Papagiannakis
- Mohammad HijjiMHMohammad Hijji
- Khan MuhammadKhan Muhammad
- 21 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (22) , 45995-46002
Abstract
Facial emotion recognition (FER) plays a critical role in understanding human behavior, especially for individuals suffering from neurological disorders (NDs) like Parkinson’s disease (PD), Multiple Sclerosis (MS), and Stroke. Early and accurate detection of emotions is crucial for both the diagnosis of associated mood disorders and continuous monitoring. However, traditional methods often fall short in providing noninvasive, real-time solutions and lack the clinical expertise necessary to identify the specific emotion types associated with each ND category. In response, this research conducted under the ALAMEDA consortium presents an Internet of Things-based FER AI Toolkit designed to enhance early diagnosis and treatment for brain diseases. The toolkit is in line with the consortium’s clinical guidelines and provides a personalized, patient-focused solution that supports the goals of Industry 5.0 in healthcare. In line with Industry 5.0 principles, the FER AI Toolkit uses edge devices to collect real-time facial data while deep learning models running on cloud servers process this data. The recognized emotions are uploaded to the Semantic Knowledge Graph (SemKG) server. This allows healthcare professionals to make informed decisions based on real-time data. Additionally, the toolkit integrates seamlessly with key components of the ALAMEDA, including the Identity Authentication Manager (IAM) for secure access and the ALAMEDA Innovation Hub (AIH) for efficient resource management. By offering continuous and personalized healthcare insights, the FER AI Toolkit helps bridge the gap between diagnosis and patient well-being, ultimately advancing healthcare systems. Training materials and video demonstrations are available at https://drive.google.com/drive/folders/1-iUz7FE2IrKHt5nMl3oGjsrCtk7Ps2bM?usp=sharing for further learning.Keywords
Funding Information
- Priority Research Centers Program (2017R1A6A1A03015562)
- GRRC program of Gyeonggi province (GRRC TUKorea2023-B03)
- European Union’s Horizon Research and Innovation Program through the ALAMEDA Project (101017558)
This publication has 34 references indexed in Scilit:
- Enhancing land cover classification via deep ensemble networkKnowledge-Based Systems, 2024
- Fine-grained vulnerability detection for medical sensor systemsInternet of Things, 2024
- Optimized efficient attention-based network for facial expressions analysis in neurological health careComputers in Biology and Medicine, 2024
- Internet of medical things and blockchain-enabled patient-centric agent through SDN for remote patient monitoring in 5G networkScientific Reports, 2024
- Multimodal Real-Time patient emotion recognition system using facial expressions and brain EEG signals based on Machine learning and Log-Sync methodsBiomedical Signal Processing and Control, 2024
- Facial expression analysis using Decomposed Multiscale Spatiotemporal NetworksExpert Systems with Applications, 2023
- To study the effect of a newly developed emotion detection and grading system software for identifying and grading expressions of patients with Parkinson’s diseaseMultimedia Tools and Applications, 2023
- The Delaware Pain Database: a set of painful expressions and corresponding norming dataPain Reports, 2020
- Towards Artificial Intelligence Driven Emotion Aware Fall Monitoring Framework Suitable for Elderly People with Neurological Disorder2020
- Challenges in Representation Learning: A Report on Three Machine Learning Contests2013