Depression Detection Using BERT on Social Media Platforms
Authors:
- 26 August 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 228-233
Abstract
Depression detection from social media has attracted significant attention for its potential to offer early intervention and support to individuals facing mental health issues. In this study, we present a comprehensive evaluation of deep learning techniques for depression detection, with a specific focus on leveraging BERT, a powerful Natural Language Processing (NLP) Transformer model. Our exploration encompasses tailored preprocessing techniques for social media text, diverse feature extraction methods, and optimized model architectures tailored for depression detection tasks using BERT. Through rigorous experimentation and evaluation, we compare the performance of different BERT-based strategies, considering metrics such as accuracy, efficiency, and scalability. Additionally, we conduct a comparative analysis of labeled and unlabeled data from the same dataset. For labeled data, we employ BERT directly, while for unlabeled data, an autoencoder is utilized following label removal. The findings indicate that BERT outperformed other methods, achieving a high F1-score of 93% on the Reddit dataset. BERT achieved an impressive test accuracy of 91.92%, surpassing the Autoencoder model, which attained 84.84%.Keywords
This publication has 18 references indexed in Scilit:
- Enhancing early depression detection with AI: a comparative use of NLP modelsSICE Journal of Control, Measurement, and System Integration, 2024
- Depression Detection Using Hybrid Transformer Networks2023
- BERT-Based Approach for Suicide and Depression Identification2023
- Transformer Based Approach for Depression Detection2023
- Novel depression detection technique using Bert on social media2022
- Depression Classification From Tweets Using Small Deep Transfer Learning Language ModelsIEEE Access, 2022
- Transformer-based deep learning models for the sentiment analysis of social media dataArray, 2022
- Deep Learning for Suicide and Depression Identification with Unsupervised Label Correction2021
- Improving Distantly-Supervised Relation Extraction Through BERT-Based Label and Instance EmbeddingsIEEE Access, 2021
- Speech recognition with deep recurrent neural networks2013