A Hybrid Model for Bipolar Disorder Classification from Visual Information
Authors:
- 1 May 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4107-4111
Abstract
Bipolar Disorder (BD) is one of the most prevalent mental illnesses in the world. It has a negative impact on people’s social and personal functions. The principal indicator of BD is the extreme swing in the mood ranging from manic to depressive states. This paper addresses the challenge of detecting the BD states by monitoring affective information extracted from video recordings of structured interviews. Our goal is to classify the condition of patients suffering from BD into the clinically significant states of remission, hypo-mania, and mania. To this end, we apply a Convolutional Neural Network (CNN) model to extract facial features from video signals. We supply the features’ sequence to a Long-Short-Term Memory (LSTM) model to resolve the BD state. Our framework achieved promising results on the development set of the Turkish Audio-Visual Bipolar Disorder Corpus with the Unweighted Average Recall (UAR) of 60.67%.Keywords
This publication has 16 references indexed in Scilit:
- AVEC 20172017
- Video-based emotion recognition in the wild using deep transfer learning and score fusionImage and Vision Computing, 2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Dynamic Multimodal Measurement of Depression Severity Using Deep AutoencodingIEEE Journal of Biomedical and Health Informatics, 2017
- AVEC 20162016
- Automatic detection of social rhythms in bipolar disorderJournal of the American Medical Informatics Association, 2016
- Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification2015
- Challenges in Representation Learning: A Report on Three Machine Learning Contests2013
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech RecognitionIEEE Transactions on Audio, Speech, and Language Processing, 2011
- AVEC 2011–The First International Audio/Visual Emotion Challenge2011