X-Troll: eXplainable Detection of State-Sponsored Information Operations Agents
Authors:
- Lin TianLTLin Tian
- Xiuzhen ZhangXZXiuzhen Zhang
- Maria Myung-Hee KimMKMaria Myung-Hee Kim
- Jennifer BiggsJBJennifer Biggs
- Marian-Andrei RizoiuMRMarian-Andrei Rizoiu
Preprint
Abstract
State-sponsored trolls, malicious actors who deploy sophisticated linguistic manipulation in coordinated information campaigns, posing threats to online discourse integrity. While Large Language Models (LLMs) achieve strong performance on general natural language processing (NLP) tasks, they struggle with subtle propaganda detection and operate as ``black boxes'', providing no interpretable insights into manipulation strategies. This paper introduces X-Troll, a novel framework that bridges this gap by integrating explainable adapter-based LLMs with expert-derived linguistic knowledge to detect state-sponsored trolls and provide human-readable explanations for its decisions. X-Troll incorporates appraisal theory and propaganda analysis through specialized LoRA adapters, using dynamic gating to capture campaign-specific discourse patterns in coordinated information operations. Experiments on real-world data demonstrate that our linguistically-informed approach shows strong performance compared with both general LLM baselines and existing troll detection models in accuracy while providing enhanced transparency through expert-grounded explanations that reveal the specific linguistic strategies used by state-sponsored actors. X-Troll source code is available at: https://github.com/ltian678/xtroll_source/.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Generalizing Hate Speech Detection Using Multi-Task Learning: A Case Study of Political Public FiguresComputer Speech & Language, 2024
- Transfer learning for hate speech detection in social mediaJournal of Computational Social Science, 2023
- Riding information crises: the performance of far-right Twitter users in Australia during the 2019–2020 bushfires and the COVID-19 pandemicInformation, Communication & Society, 2023
- Propagation2Vec: Embedding partial propagation networks for explainable fake news early detectionInformation Processing & Management, 2021
- MVAN: Multi-View Attention Networks for Fake News Detection on Social MediaIEEE Access, 2021
- Assembling the Networks and Audiences of Disinformation: How Successful Russian IRA Twitter Accounts Built Their Followings, 2015–2017Journal of Communication, 2021
- Still out there: Modeling and Identifying Russian Troll Accounts on Twitter2020
- Analysing user identity via time-sensitive semantic edit distance (t-SED): a case study of Russian trolls on TwitterJournal of Computational Social Science, 2019
- The spread of true and false news onlineScience, 2018
- Cyber-diplomacy: the making of an international society in the digital ageGlobal Affairs, 2017