Reliability Analysis of Psychological Concept Extraction and Classification in User-penned Text
Preprint
Abstract
The social NLP research community witness a recent surge in the computational advancements of mental health analysis to build responsible AI models for a complex interplay between language use and self-perception. Such responsible AI models aid in quantifying the psychological concepts from user-penned texts on social media. On thinking beyond the low-level (classification) task, we advance the existing binary classification dataset, towards a higher-level task of reliability analysis through the lens of explanations, posing it as one of the safety measures. We annotate the LoST dataset to capture nuanced textual cues that suggest the presence of low self-esteem in the posts of Reddit users. We further state that the NLP models developed for determining the presence of low self-esteem, focus more on three types of textual cues: (i) Trigger: words that triggers mental disturbance, (ii) LoST indicators: text indicators emphasizing low self-esteem, and (iii) Consequences: words describing the consequences of mental disturbance. We implement existing classifiers to examine the attention mechanism in pre-trained language models (PLMs) for a domain-specific psychology-grounded task. Our findings suggest the need of shifting the focus of PLMs from Trigger and Consequences to a more comprehensive explanation, emphasizing LoST indicators while determining low self-esteem in Reddit posts.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Constructing a disease database and using natural language processing to capture and standardize free text clinical informationScientific Reports, 2023
- Low self-esteem and the formation of global self-performance estimates in emerging adulthoodTranslational Psychiatry, 2022
- Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019The Lancet Psychiatry, 2022
- Why Do Female Domestic Violence Victims Remain in or Leave Abusive Relationships? A Qualitative StudyJournal of Aggression, Maltreatment & Trauma, 2022
- Non-suicidal self-injury in eating disorders: Prevalence, characteristics, DSM-5 proposed diagnostic criteria, and correlatesJournal of Affective Disorders Reports, 2022
- Knowledge-Intensive Language Understanding for Explainable AIIEEE Internet Computing, 2021
- Work and suicide: An interdisciplinary systematic literature reviewJournal of Organizational Behavior, 2021
- The FAIR Guiding Principles for scientific data management and stewardshipScientific Data, 2016
- Risk and protective factors predicting multiple suicide attemptsPsychiatry Research, 2013
- Rejection Sensitivity, Social Withdrawal, and Loneliness in Young AdultsJournal of Applied Social Psychology, 2012