Anchor-Based Multimodal Verification: A Dynamic Query Framework for Fake News Forensics in Short Videos
- 28 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 21 (15566013) , 2047-2060
Abstract
The proliferation of maliciously altered short videos on social media platforms poses a significant threat to information security ecosystems, eroding public trust in digital media. Despite recent advancements in detecting fake video news, significant challenges remain in the forensic analysis of short videos, leading to issues of bias. First, as technology rapidly advances, fake videos are becoming increasingly semantically convincing, undermining the effectiveness of current classification methods. Second, the heterogeneous nature of video modalities (visual, textual, audio) creates critical challenges for models to learn discriminative feature representations. To address these challenges, we propose a dynamic query framework for fake news forensics in short videos, termed the Semantic Guided Adaptive Network (SGAN). Our approach is motivated by the need to utilize superficial alignment to identify suspicious manipulations through anchor-based verification and to leverage the adaptive capability of learnable queries to learn the heterogeneous boundary in each modality. Specifically, SGAN comprises a verification module and a flexible query learning module. The verification module employs text as the anchor to verify detailed context, mining fine-grained information while emphasizing key features, thereby providing candidate manipulations for downstream modules. The query learning module leverages learnable queries to map heterogeneous forensic features and integrates them through multi-level fusion for decision-making. Extensive experiments conducted on two widely used datasets demonstrate the effectiveness and generalization of the proposed method.Keywords
Funding Information
- Guangxi Natural Science Foundation Key Project (2025GXNSFDA069017)
- National Natural Science Foundation of China (62276072)
- Specific Research Project of Guangxi for Research Bases and Talents (AD25069071)
- Open Research Project of the State Key Laboratory of Media Convergence and Communication, Communication University of China, China (SKLMCC2023KF005)
- Bagui Scholar Program of Guangxi
- National Natural Science Foundation of China (62476097)
- Hong Kong Research Grants Council under the General Research Fund (PolyU 15200023)
- Innovation Project of Guangxi Graduate Education (YCBZ2025013)
This publication has 38 references indexed in Scilit:
- Consistency-Aware Fake Videos Detection on Short Video Platforms2025
- Deepfake video detection: challenges and opportunitiesArtificial Intelligence Review, 2024
- Video Captioning using Sentence Vector-enabled Convolutional Framework with Short-Connected LSTMMultimedia Tools and Applications, 2023
- A Multimodal Misinformation Detector for COVID-19 Short Videos on TikTok2021
- The Matthews Correlation Coefficient (MCC) is More Informative Than Cohen’s Kappa and Brier Score in Binary Classification AssessmentIEEE Access, 2021
- User-Generated Short Video Content in Social Media. A Case Study of TikTok2020
- Rethinking Zero-Shot Video Classification: End-to-End Training for Realistic Applications2020
- Large-Scale Video Classification with Convolutional Neural Networks2014
- Long Short-Term Memory2012
- Thermal-Visible Video Fusion for Moving Target Tracking and Pedestrian Classification2007