A Hybrid Model for Depression Detection With Transformer and Bi-directional Long Short-Term Memory
Authors:
- 6 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2727-2734
Abstract
Failure to diagnose and treat depression in a timely manner causes more than three hundred million people suffering from this mental health disorder worldwide. Depression, a global problem, affects not only people’s emotions, but also their physical and mental states. Early detection of depression is very important for the treatment of patients, so we need to achieve excellent accuracy and practicability of depression detection, among which the most important and challenging problem is to design an effective and robust depression detection model. To solve this problem, we propose a hybrid deep learning model, RoBERTa-BiLSTM, to extract features from depression text sequences. We know that the sequence models require a longer computation time as the processing is done sequentially. However, the Transformer models require less execution time with parallelized processing. This model consolidates the strengths of sequence model and Transformer model while suppressing the limitations of sequence model. Specifically, the model maps the words into a compact meaningful word embedding space through the Robustly optimized BERT approach, and then effectively captures the long-distance contextual semantics using the Bidirectional Long Short-Term Memory model. On the DAIC-WOZ and EATD-Corpus benchmark, our experiments demonstrate that our model outperforms state-of-art methods by a substantial margin.Keywords
Funding Information
- National Science Foundation
- Ministry of Education
- Chongqing University
This publication has 37 references indexed in Scilit:
- A review of depression and suicide risk assessment using speech analysisSpeech Communication, 2015
- On the Stratification of Multi-label Data2011
- Under-diagnosis of common chronic diseases: prevalence and impact on human healthInternational Journal Of Clinical Practice, 2007
- Language use of depressed and depression-vulnerable college studentsCognition and Emotion, 2004
- Long Short-Term MemoryNeural Computation, 1997
- The Advantage of Early Treatment Intervention in Recurrent DepressionArchives of General Psychiatry, 1989
- An ethological description of depressionActa Psychiatrica Scandinavica, 1988
- The Ethological Approach to the Assessment of Depressive DisordersJournal of Nervous & Mental Disease, 1984
- Nonverbal cues for depression.Journal of Abnormal Psychology, 1974
- A RATING SCALE FOR DEPRESSIONJournal of Neurology, Neurosurgery & Psychiatry, 1960