Classification of Hope in Textual Data using Transformer-Based Models
Preprint
Abstract
This paper presents a transformer-based approach for classifying hope expressions in text. We developed and compared three architectures (BERT, GPT-2, and DeBERTa) for both binary classification (Hope vs. Not Hope) and multiclass categorization (five hope-related categories). Our initial BERT implementation achieved 83.65% binary and 74.87% multiclass accuracy. In the extended comparison, BERT demonstrated superior performance (84.49% binary, 72.03% multiclass accuracy) while requiring significantly fewer computational resources (443s vs. 704s training time) than newer architectures. GPT-2 showed lowest overall accuracy (79.34% binary, 71.29% multiclass), while DeBERTa achieved moderate results (80.70% binary, 71.56% multiclass) but at substantially higher computational cost (947s for multiclass training). Error analysis revealed architecture-specific strengths in detecting nuanced hope expressions, with GPT-2 excelling at sarcasm detection (92.46% recall). This study provides a framework for computational analysis of hope, with applications in mental health and social media analysis, while demonstrating that architectural suitability may outweigh model size for specialized emotion detection tasks.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- UrduHope: Analysis of hope and hopelessness in Urdu textsKnowledge-Based Systems, 2024
- Is text preprocessing still worth the time? A comparative survey on the influence of popular preprocessing methods on Transformers and traditional classifiersInformation Systems, 2023
- Multilingual hope speech detection: A Robust framework using transfer learning of fine-tuning RoBERTa modelJournal of King Saud University Computer and Information Sciences, 2023
- PolyHope: Two-level hope speech detection from tweetsExpert Systems with Applications, 2023
- Multilingual hope speech detection in English and Dravidian languagesInternational Journal of Data Science and Analytics, 2022
- AI4People—An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and RecommendationsMinds and Machines, 2018
- A survey on sentiment analysis and opinion mining for social multimediaMultimedia Tools and Applications, 2018
- Detecting Hate Speech on Twitter Using a Convolution-GRU Based Deep Neural Network2018
- A survey of multimodal sentiment analysisImage and Vision Computing, 2017
- Twitter mood predicts the stock marketJournal of Computational Science, 2011