MultiVis-Agent: A Multi-Agent Framework with Logic Rules for Reliable and Comprehensive Cross-Modal Data Visualization
Authors:
- Jinwei LuJLJinwei Lu
- Yuanfeng SongYSYuanfeng Song
- Chen ZhangCZChen Zhang
- Raymond Chi-Wing WongRWRaymond Chi-Wing Wong
Preprint
Abstract
Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental limitations: single-modality input, one-shot generation, and rigid workflows. While LLM-based approaches show potential for these complex requirements, they introduce reliability challenges including catastrophic failures and infinite loop susceptibility. To address this gap, we propose MultiVis-Agent, a logic rule-enhanced multi-agent framework for reliable multi-modal and multi-scenario visualization generation. Our approach introduces a four-layer logic rule framework that provides mathematical guarantees for system reliability while maintaining flexibility. Unlike traditional rule-based systems, our logic rules are mathematical constraints that guide LLM reasoning rather than replacing it. We formalize the MultiVis task spanning four scenarios from basic generation to iterative refinement, and develop MultiVis-Bench, a benchmark with over 1,000 cases for multi-modal visualization evaluation. Extensive experiments demonstrate that our approach achieves 75.63% visualization score on challenging tasks, significantly outperforming baselines (57.54-62.79%), with task completion rates of 99.58% and code execution success rates of 94.56% (vs. 74.48% and 65.10% without logic rules), successfully addressing both complexity and reliability challenges in automated visualization generation.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- CoVis: Neural and LLM-Driven Multi-Turn Interactions for Conversational Text-to-Visualization GenerationThe VLDB Journal, 2025
- FeVisQA: Free-Form Question Answering over Data Visualizations2025
- Towards Robustness of Text-to-Visualization Translation Against Lexical and Phrasal Variability2025
- prompt4vis: prompting large language models with example mining for tabular data visualizationThe VLDB Journal, 2025
- Natural Language Interfaces for Tabular Data Querying and Visualization: A SurveyIEEE Transactions on Knowledge and Data Engineering, 2024
- Chat2VIS: Generating Data Visualizations via Natural Language Using ChatGPT, Codex and GPT-3 Large Language ModelsIEEE Access, 2023
- FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow SystemIEEE Transactions on Visualization and Computer Graphics, 2019
- Orko: Facilitating Multimodal Interaction for Visual Exploration and Analysis of NetworksIEEE Transactions on Visualization and Computer Graphics, 2017
- Applying Pragmatics Principles for Interaction with Visual AnalyticsIEEE Transactions on Visualization and Computer Graphics, 2017
- VisFlow - Web-based Visualization Framework for Tabular Data with a Subset Flow ModelIEEE Transactions on Visualization and Computer Graphics, 2016