VizDefender: Unmasking Visualization Tampering Through Proactive Localization and Intent Inference
- 2 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (6) , 4720-4730
Abstract
The integrity of data visualizations is increasingly threatened by image editing techniques that enable subtle yet deceptive tampering. Through a formative study, we define this challenge and categorize tampering techniques into two primary types: data manipulation and visual encoding manipulation. To address this, we present VizDefender, a framework for tampering detection and analysis. The framework integrates two core components: 1) a semi-fragile watermark module that protects the visualization by embedding a location map to images, which allows for the precise localization of tampered regions while preserving visual quality, and 2) an intent analysis module that leverages Multimodal Large Language Models (MLLMs) to interpret manipulation, inferring the attacker's intent and misleading effects. Extensive evaluations and user studies demonstrate the effectiveness of our methods.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62572191)
- National Natural Science Foundation of China (62472178)
- Natural Science Foundation of Shanghai Municipality (24ZR1418300)
This publication has 60 references indexed in Scilit:
- The Role of Metacognition in Understanding Deceptive Bar Charts2024
- Factuality challenges in the era of large language models and opportunities for fact-checkingNature Machine Intelligence, 2024
- Simple Baselines for Image Restoration2022
- HiDDeN: Hiding Data With Deep Networks2018
- Densely Connected Convolutional Networks2017
- Deep Residual Learning for Image Recognition2016
- Microsoft COCO: Common Objects in Context2014
- Using High-Dimensional Image Models to Perform Highly Undetectable Steganography2010
- High Capacity Steganographic Method Based Upon JPEG2008
- Multiresolution watermarking for images and videoIEEE Transactions on Circuits and Systems for Video Technology, 1999