PsychBERT: A Mental Health Language Model for Social Media Mental Health Behavioral Analysis
Authors:
- 9 December 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1077-1082
Abstract
Mental health behaviors are now recognized as primary factors contributing to suicide. This paper puts forth a novel mental health language model to address mental health and makes several contributions. First, it proposes a taxonomy and puts forth a comprehensive dataset of social media text. Second, it proposes a two-stage framework, first discriminating text relevant to mental health from non-relevant text and then carrying out multi-class classification for detection of mental health behaviors. Third, it proposes a novel mental health language model, PsychBERT, which is pretrained on a large corpus of biomedical literature on mental health and social media data. Fourth, the framework additionally incorporates components that enhance its explainability. Our evaluation shows that the proposed framework is outperforms state-of-the-art methods and is interpretable. Pre-trained PsychBERT is made publicly available for the community at https://huggingface.co/mnaylor/psychbert-cased.Keywords
This publication has 13 references indexed in Scilit:
- Maximizing the applied value of structural models of psychopathology: Introduction to a special issue of Personality and Mental HealthPersonality and Mental Health, 2020
- Sentiment Analysis of Azerbaijani twits Using Logistic Regression, Naive Bayes and SVM2019
- Explainable AI: A Brief Survey on History, Research Areas, Approaches and Challenges2019
- Stop explaining black box machine learning models for high stakes decisions and use interpretable models insteadNature Machine Intelligence, 2019
- Depression Detection via Harvesting Social Media: A Multimodal Dictionary Learning Solution2017
- The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies.Journal of Abnormal Psychology, 2017
- Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media2016
- Affective and Content Analysis of Online Depression CommunitiesIEEE Transactions on Affective Computing, 2014
- Analysis of syntax and word use to predict successful participation in guided self-help for anxiety and depressionPsychiatry Research, 2010
- On the practice of dichotomization of quantitative variables.Psychological Methods, 2002