Demystifying Mental Health by Decoding Facial Action Unit Sequences
Open Access
- 9 July 2024
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 8 (7) , 78
Abstract
Mental health is indispensable for effective daily functioning and stress management. Facial expressions may provide vital clues about the mental state of a person as they are universally consistent across cultures. This study intends to detect the emotional variances through facial micro-expressions using facial action units (AUs) to identify probable mental health issues. In addition, convolutional neural networks (CNN) were used to detect and classify the micro-expressions. Further, combinations of AUs were identified for the segmentation of micro-expressions classes using K-means square. Two benchmarked datasets CASME II and SAMM were employed for the training and evaluation of the model. The model achieved an accuracy of 95.62% on CASME II and 93.21% on the SAMM dataset, respectively. Subsequently, a case analysis was done to identify depressive patients using the proposed framework and it attained an accuracy of 92.99%. This experiment revealed the fact that emotions like disgust, sadness, anger, and surprise are the prominent emotions experienced by depressive patients during communication. The findings suggest that leveraging facial action units for micro-expression detection offers a promising approach to mental health diagnostics.Keywords
This publication has 69 references indexed in Scilit:
- A novel approach to forecasting the mental well-being using machine learningAlexandria Engineering Journal, 2023
- Micro-expression action unit recognition based on dynamic image and spatial pyramidThe Journal of Supercomputing, 2023
- A novel enhanced convolution neural network with extreme learning machine: facial emotional recognition in psychology practicesMultimedia Tools and Applications, 2022
- Deep learning-based facial emotion recognition for human–computer interaction applicationsNeural Computing and Applications, 2021
- Enhanced deep learning algorithm development to detect pain intensity from facial expression imagesExpert Systems with Applications, 2020
- Automatic recognition of student emotions from facial expressions during a lectureComputers & Education, 2020
- Going deeper in hidden sadness recognition using spontaneous micro expressions databaseMultimedia Tools and Applications, 2019
- Less is more: Micro-expression recognition from video using apex frameSignal Processing: Image Communication, 2018
- Toward a new definition of mental healthWorld Psychiatry, 2015
- Police lie detection accuracy: The effect of lie scenario.Law and Human Behavior, 2009