Mario at EXIST 2025: A Simple Gateway to Effective Multilingual Sexism Detection
Preprint
Abstract
This paper presents our approach to EXIST 2025 Task 1, addressing text-based sexism detection in English and Spanish tweets through hierarchical Low-Rank Adaptation (LoRA) of Llama 3.1 8B. Our method introduces conditional adapter routing that explicitly models label dependencies across three hierarchically structured subtasks: binary sexism identification, source intention detection, and multilabel sexism categorization. Unlike conventional LoRA applications that target only attention layers, we apply adaptation to all linear transformations, enhancing the model's capacity to capture task-specific patterns. In contrast to complex data processing and ensemble approaches, we show that straightforward parameter-efficient fine-tuning achieves strong performance. We train separate LoRA adapters (rank=16, QLoRA 4-bit) for each subtask using unified multilingual training that leverages Llama 3.1's native bilingual capabilities. The method requires minimal preprocessing and uses standard supervised learning. Our multilingual training strategy eliminates the need for separate language-specific models, achieving 1.7-2.4\% F1 improvements through cross-lingual transfer. With only 1.67\% trainable parameters compared to full fine-tuning, our approach reduces training time by 75\% and model storage by 98\%, while achieving competitive performance across all subtasks (ICM-Hard: 0.6774 for binary classification, 0.4991 for intention detection, 0.6519 for multilabel categorization).Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Behavioral Homophily in Social Media via Inverse Reinforcement Learning: A Reddit Case Study2025
- Before It's Too Late: A State Space Model for the Early Prediction of Misinformation and Disinformation Engagement2025
- Generalizing Hate Speech Detection Using Multi-Task Learning: A Case Study of Political Public FiguresComputer Speech & Language, 2024
- Transfer learning for hate speech detection in social mediaJournal of Computational Social Science, 2023
- The effectiveness of moderating harmful online contentProceedings of the National Academy of Sciences, 2023
- Interval-censored Transformer Hawkes: Detecting Information Operations using the Reaction of Social Systems2023
- Riding information crises: the performance of far-right Twitter users in Australia during the 2019–2020 bushfires and the COVID-19 pandemicInformation, Communication & Society, 2023
- Emotionally Informed Hate Speech Detection: A Multi-target PerspectiveCognitive Computation, 2021
- Automatic Classification of Sexism in Social Networks: An Empirical Study on Twitter DataIEEE Access, 2020
- Misogyny Detection in Twitter: a Multilingual and Cross-Domain StudyInformation Processing & Management, 2020