Large Language Models for Multimodal Fact-Checking: Methodological Advances and Persistent Challenges
Open Access
- 18 November 2026
- journal article
- review article
- Published by MDPI AG in Mathematics
- Vol. 14 (22) , 4243
Abstract
Fact-checking aims to assign truth values to claims within a specified context. Unimodal fact-checking methods, due to modality fragmentation and inadequate adaptiveness, struggle in complex scenarios where multimodal misinformation is interconnected. The rapid advancement of generative large language models (LLMs) has provided a novel technological paradigm for multimodal fact-checking. With their capabilities in deep semantic understanding and cross-modal alignment, LLMs can significantly enhance the accuracy, interpretability, and generalizability of misinformation detection. Synthesizing representative studies from 2018 to 2026 retrieved via a multi-dimensional keyword search, two-step screening, and citation chaining, we comprehensively survey the subtask arrangements, LLM-based methodologies, and relevant datasets for both unimodal and multimodal fact-checking tasks. Following the standard fact-checking pipeline, we comprehensively review existing methods across four key stages, namely Claim Detection and Extraction, Evidence Retrieval, Verdict Prediction, and Justification Production, providing a structured perspective for method comparison and evaluation. Our synthesis indicates that while multimodal large language models (MLLMs) enhance cross-modal understanding and verification flexibility, fine-grained visual–textual consistency and evidential sufficiency remain critical challenges. We provide a comprehensive survey of fact-checking research and offer insights into the development of next-generation fact-checking systems expected to be more robust, scalable, and adaptable across diverse information environments.Keywords
This publication has 413 references indexed in Scilit:
- The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority2023
- A Study of Misinformation in Audio Messages Shared in WhatsApp Groups2021
- The CLEF-2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News2021
- Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media2020
- BERT for Evidence Retrieval and Claim Verification2020
- Graph convolutional networks with higher‐order pooling for semisupervised node classificationConcurrency and Computation: Practice and Experience, 2020
- Fighting Fake News: Image Splice Detection via Learned Self-Consistency2018
- Stacked Cross Attention for Image-Text Matching2018
- Differential Privacy2006
- The Philosophy of Information Retrieval Evaluation2002