Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation
Authors:
Preprint
Abstract
The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, can be weaponised to produce sophisticated and persuasive disinformation, yet they also hold promise for enhancing detection and mitigation strategies. This paper investigates the complex dynamics between LLMs and disinformation through a communication game that simulates online forums, inspired by the game Werewolf, with 25 participants. We analyse how Disinformers, Moderators, and Users leverage LLMs to advance their goals, revealing both the potential for misuse and combating disinformation. Our findings highlight the varying uses of LLMs depending on the participants' roles and strategies, underscoring the importance of understanding their effectiveness in this context. We conclude by discussing implications for future LLM development and online platform design, advocating for a balanced approach that empowers users and fosters trust while mitigating the risks of LLM-assisted disinformation.Keywords
All Related Versions
This publication has 62 references indexed in Scilit:
- Combating misinformation in the age of LLMs: Opportunities and challengesAI Magazine, 2024
- Do people trust humans more than ChatGPT?Journal of Behavioral and Experimental Economics, 2024
- The Dark Side of Language Models: Exploring the Potential of LLMs in Multimedia Disinformation Generation and DisseminationMachine Learning with Applications, 2024
- “Deceptive” clickbait headlines: Relevance, intentions, and liesJournal of Pragmatics, 2023
- Small town propaganda: The content and emotions of politicized digital local news in the United StatesPoetics, 2022
- Persuasion strategies of misinformation-containing posts in the social mediaInformation Processing & Management, 2021
- Use of bot and content flags to limit the spread of misinformation among social networks: a behavior and attitude surveySocial Network Analysis and Mining, 2021
- All the News That’s Fit to Fabricate: AI-Generated Text as a Tool of Media MisinformationJournal of Experimental Political Science, 2020
- Deep learning for misinformation detection on online social networks: a survey and new perspectivesSocial Network Analysis and Mining, 2020
- How Censorship in China Allows Government Criticism but Silences Collective ExpressionAmerican Political Science Review, 2013