Cyberbullying Detection Using PCA Extracted GLOVE Features and RoBERTaNet Transformer Learning Model
Open Access
- 5 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 12 (5) , 3881-3890
Abstract
Online platforms are nurturing social interactions, yet regrettably, they have also led to the proliferation of antisocial behaviors such as cyberbullying, trolling, and hate speech on a global scale. The identification of hate speech and aggression has become indispensable in the fight against cyberbullying and online harassment. Cyberbullying encompasses the use of aggressive and offensive language, including rude, insulting, hateful, and teasing comments, to inflict harm on individuals through social media platforms. Human moderation is both sluggish and costly, rendering it impractical in light of the exponential growth of data. Consequently, automated detection systems are imperative to effectively combat trolling. This study addresses the challenge of automatically discerning cyberbullying in tweets sourced from a publicly available cyberbullying dataset. The proposed methodology leverages the robustly optimized bidirectional encoder representations from transformers approach (RoBERTa), integrating principle component analysis (PCA) extracted global vectors for word representation (GLOVE) word embedding features. Furthermore, our proposed approach is benchmarked against state-of-the-art machine learning, deep learning, and transformer-based methods, utilizing the GLOVE word embedding technique. Statistical analyses reveal that our proposed model outperforms its counterparts, achieving a 0.98 accuracy and recall rate with 0.97 of precision and F1 score in detecting cyberbullying tweets. Results from k -fold cross validation further corroborate the superior performance of our proposed model.Keywords
This publication has 43 references indexed in Scilit:
- Enhancing cyberbullying detection: a comparative study of ensemble CNN–SVM and BERT modelsSocial Network Analysis and Mining, 2023
- Social network analysis using deep learning: applications and schemesSocial Network Analysis and Mining, 2021
- Data, measurement, and causal inferences in machine learning: opportunities and challenges for marketingJournal of Marketing Theory and Practice, 2021
- SOSNet: A Graph Convolutional Network Approach to Fine-Grained Cyberbullying Detection2020
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- Predicting Cyberbullying on Social Media in the Big Data Era Using Machine Learning Algorithms: Review of Literature and Open ChallengesIEEE Access, 2019
- Classification of various attacks and their defence mechanism in online social networks: a surveyEnterprise Information Systems, 2019
- Cervical Cancer Diagnosis Using Random Forest Classifier With SMOTE and Feature Reduction TechniquesIEEE Access, 2018
- Multiple watermarking technique for securing online social network contents using Back Propagation Neural NetworkFuture Generation Computer Systems, 2018
- Deep Learning for Detecting Cyberbullying Across Multiple Social Media Platforms2018