The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake News
Authors:
- Yuhan LiuYLYuhan Liu
- Yuxuan LiuYLYuxuan Liu
- Xiaoqing ZhangXZXiaoqing Zhang
- Xiuying ChenXCXiuying Chen
- Rui YanRYRui Yan
Preprint
Abstract
In today's digital environment, the rapid propagation of fake news via social networks poses significant social challenges. Most existing detection methods either employ traditional classification models, which suffer from low interpretability and limited generalization capabilities, or craft specific prompts for large language models (LLMs) to produce explanations and results directly, failing to leverage LLMs' reasoning abilities fully. Inspired by the saying that "truth becomes clearer through debate," our study introduces a novel multi-agent system with LLMs named TruEDebate (TED) to enhance the interpretability and effectiveness of fake news detection. TED employs a rigorous debate process inspired by formal debate settings. Central to our approach are two innovative components: the DebateFlow Agents and the InsightFlow Agents. The DebateFlow Agents organize agents into two teams, where one supports and the other challenges the truth of the news. These agents engage in opening statements, cross-examination, rebuttal, and closing statements, simulating a rigorous debate process akin to human discourse analysis, allowing for a thorough evaluation of news content. Concurrently, the InsightFlow Agents consist of two specialized sub-agents: the Synthesis Agent and the Analysis Agent. The Synthesis Agent summarizes the debates and provides an overarching viewpoint, ensuring a coherent and comprehensive evaluation. The Analysis Agent, which includes a role-aware encoder and a debate graph, integrates role embeddings and models the interactions between debate roles and arguments using an attention mechanism, providing the final judgment.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- MobileSteward: Integrating Multiple App-Oriented Agents with Self-Evolution to Automate Cross-App Instructions2025
- Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate2024
- ChatDev: Communicative Agents for Software Development2024
- A Topic-aware Summarization Framework with Different Modal Side Information2023
- Learn over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection2023
- Improving the Robustness of Summarization Systems with Dual Augmentation2023
- FakeBERT: Fake news detection in social media with a BERT-based deep learning approachMultimedia Tools and Applications, 2021
- FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social MediaBig Data, 2020
- Fake news on Twitter during the 2016 U.S. presidential electionScience, 2019
- Twitter mood predicts the stock marketJournal of Computational Science, 2011