Hierarchical Multi-Stage BERT Fusion Framework with Dual Attention for Enhanced Cyberbullying Detection in Social Media
Preprint
Abstract
Detecting and classifying cyberbullying in social media is hard because of the complex nature of online language and the changing nature of content. This study presents a multi-stage BERT fusion framework. It uses hierarchical embeddings, dual attention mechanisms, and extra features to improve detection of cyberbullying content. The framework combines BERT embeddings with features like sentiment and topic information. It uses self-attention and cross-attention to align features and has a hierarchical classification head for multi-category classification. A dynamic loss balancing strategy helps optimize learning and improves accuracy, precision, recall, and F1-score. These results show the model's strong performance and potential for broader use in analyzing social media content.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Enhancing healthcare recommendation systems with multimodal LLMs-based MOE architectureIET Conference Proceedings, 2025
- Integrated Machine Learning for Enhanced Supply Chain Risk Prediction2024
- Transfer Contrastive Learning for Raman Spectroscopy Skin Cancer Tissue ClassificationIEEE Journal of Biomedical and Health Informatics, 2024
- A Multi-Objective Recommender System for Enhanced Consumer Behavior Prediction in E-Commerce2024
- Enhancing Healthcare Through Large Language Models: A Study on Medical Question Answering2024
- Deviance matrix factorizationElectronic Journal of Statistics, 2023