Cross-Dialectal Transfer Learning for Offensive Language Detection in Arabic
Open Access
- 27 March 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 48182-48197
Abstract
Automated offensive language detection (OLD) is essential for online safety, yet remains particularly challenging for under-resourced languages and their dialectal variations. This paper addresses these challenges by evaluating OLD across three low-resource Arabic dialects: Egyptian, Libyan, and Levantine, using newly collected dialect-specific datasets and a novel parallel corpus for controlled cross-dialect analysis.We benchmark a wide range of models, including encoder-only, encoder–decoder, and decoder-only Large Language Models (LLMs), alongside traditional machine learning baselines (XGBoost, LightGBM), under zero-shot, few-shot, and fine-tuned settings. Our experiments reveal that task-specific fine-tuning consistently delivers the highest performance, especially for models pre-trained on Arabic corpora such as AraBERT, while few-shot learning yields modest and sometimes unstable gains. Surprisingly, classical models leveraging AraBERT embeddings remain competitive in zero-shot settings. Cross-dialect evaluations further highlight substantial performance variability driven by dialectal distance, lexical ambiguity, and contextual offensiveness. These findings offer a comprehensive benchmark for OLD in dialectal Arabic and provide practical guidance for developing robust moderation systems in linguistically diverse, low-resource environments.Keywords
This publication has 36 references indexed in Scilit:
- Transformers and Deep Learning Models for Hate Speech Detection in the Dialects Arabic Language2026
- The dialects gap: A multi-task learning approach for enhancing hate speech detection in Arabic dialectsExpert Systems with Applications, 2025
- Advancing offensive language detection in Arabic social media: a BERT-based ensemble learning approachSocial Network Analysis and Mining, 2024
- Detection of Arabic offensive language in social media using machine learning modelsIntelligent Systems with Applications, 2024
- Building Text and Speech Benchmark Datasets and Models for Low‐Resourced East African Languages: Experiences and LessonsApplied AI Letters, 2024
- Detection of hate speech in Arabic tweets using deep learningMultimedia Systems, 2021
- A Framework for Hate Speech Detection Using Deep Convolutional Neural NetworkIEEE Access, 2020
- Hate and offensive speech detection on Arabic social mediaOnline Social Networks and Media, 2020
- Towards Accurate Detection of Offensive Language in Online Communication in ArabicProcedia Computer Science, 2018
- Introduction to Arabic Natural Language Processing2010