Enhanced Multimodal Depression Detection With Emotion Prompts
Authors:
- 6 April 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Depression is a pervasive mental health disorder that remains frequently undiagnosed and untreated due to societal barriers and the subjective nature of its symptoms. Leveraging recent advances in large language models (LLMs), we propose a novel depression detection pipeline that generates emotion prompts tailored to individual data, enhancing detection accuracy. Our approach integrates cross-modality fusion via cross attention mechanisms to combine depressive and emotional features, creating a comprehensive representation of depression indicators. Evaluated on the E-DAIC and EATD datasets, our method outperforms state-of-the-art techniques, demonstrating its potential for more precise emotion-based depression detection.Keywords
This publication has 21 references indexed in Scilit:
- Depression Diagnosis and Analysis via Multimodal Multi-order Factor Fusion2024
- A Sentiment Pre-trained Text-Guided Multimodal Cross-Attention Transformer for Improved Depression DetectionAnnual International Conference of the IEEE Engineering in Medicine and Biology Society, 2024
- EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning2024
- Multi-Modal and Multi-Task Depression Detection with Sentiment Assistance2024
- CANAMRF: An Attention-Based Model for Multimodal Depression Detection2023
- The social cost of depression: Investigating the impact of impaired social emotion regulation, social cognition, and interpersonal behavior on social functioningJournal of Affective Disorders Reports, 2023
- Global Prevalence of Depression among Heart Failure Patients: A Systematic Review and Meta-AnalysisCurrent Problems in Cardiology, 2022
- Climate and Weather: Inspecting Depression Detection via Emotion Recognition2022
- Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal MessagesIEEE Intelligent Systems, 2016
- The PHQ-8 as a measure of current depression in the general populationJournal of Affective Disorders, 2009