Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities
Preprint
Abstract
Depression has proven to be a significant public health issue, profoundly affecting the psychological well-being of individuals. If it remains undiagnosed, depression can lead to severe health issues, which can manifest physically and even lead to suicide. Generally, Diagnosing depression or any other mental disorder involves conducting semi-structured interviews alongside supplementary questionnaires, including variants of the Patient Health Questionnaire (PHQ) by Clinicians and mental health professionals. This approach places significant reliance on the experience and judgment of trained physicians, making the diagnosis susceptible to personal biases. Given that the underlying mechanisms causing depression are still being actively researched, physicians often face challenges in diagnosing and treating the condition, particularly in its early stages of clinical presentation. Recently, significant strides have been made in Artificial neural computing to solve problems involving text, image, and speech in various domains. Our analysis has aimed to leverage these state-of-the-art (SOTA) models in our experiments to achieve optimal outcomes leveraging multiple modalities. The experiments were performed on the Extended Distress Analysis Interview Corpus Wizard of Oz dataset (E-DAIC) corpus presented in the Audio/Visual Emotion Challenge (AVEC) 2019 Challenge. The proposed solutions demonstrate better results achieved by Proprietary and Open-source Large Language Models (LLMs), which achieved a Root Mean Square Error (RMSE) score of 3.98 on Textual Modality, beating the AVEC 2019 challenge baseline results and current SOTA regression analysis architectures. Additionally, the proposed solution achieved an accuracy of 71.43% in the classification task. The paper also includes a novel audio-visual multi-modal network that predicts PHQ-8 scores with an RMSE of 6.51.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Depression Diagnosis and Analysis via Multimodal Multi-order Factor Fusion2024
- Enhancing early depression detection with AI: a comparative use of NLP modelsSICE Journal of Control, Measurement, and System Integration, 2024
- Reading Between the Frames: Multi-modal Depression Detection in Videos from Non-verbal Cues2024
- Exploring the Capabilities of a Language Model-Only Approach for Depression Detection in Text Data2023
- Diagnosis of Depression Based on Four-Stream Model of Bi-LSTM and CNN From Audio and Text InformationIEEE Access, 2022
- A Multi-modal Feature Layer Fusion Model for Assessment of Depression Based on Attention Mechanisms2022
- Major Depressive Disorder: Advances in Neuroscience Research and Translational ApplicationsNeuroscience Bulletin, 2021
- Multimodal Deep Learning Framework for Mental Disorder Recognition2020
- OpenFace 2.0: Facial Behavior Analysis Toolkit2018
- The PHQ-8 as a measure of current depression in the general populationJournal of Affective Disorders, 2009