RuleScope: Semantic-Aware Authoring of Data Validation Rules
- 26 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (8) , 7500-7516
Abstract
Data validation is a crucial step in data analytics workflows that assesses and ensures the reliability of data flowing into analytical processes. One common approach to data validation involves defining validation rules, which provide explicit constraints and conditions that data must satisfy. However, creating accurate and effective validation rules remains challenging for many practitioners. This challenge stems from the need for practitioners to understand both data structures and their domain-specific semantic relationships. Recent studies have proposed automated approaches to generate validation rules by deriving patterns from data properties. However, these approaches generate rules with limited interpretability and lack support for rule verification and modification, making the rules difficult to understand and adapt. To address these limitations in current validation rule authoring approaches, we present RuleScope, an interactive system for authoring data validation rules through semantic-aware rule generation, visualization, and refinement. RuleScope employs an LLM-based workflow to generate interpretable rules by analyzing data semantics and incorporating domain knowledge. To facilitate rule comprehension, we design a matrix-based visualization that helps users understand rules and analyze validation results. Additionally, RuleScope enables users to interactively refine rules. We evaluate the LLM-based workflow through model evaluation on datasets from different domains and assess RuleScope's usability and effectiveness through two case studies and a user study.Keywords
This publication has 70 references indexed in Scilit:
- Visual comparative analytics of multimodal transportationVisual Informatics, 2025
- ArtEyer: Enriching GPT-based agents with contextual data visualizations for fine art authenticationVisual Informatics, 2024
- VisCI: A visualization framework for anomaly detection and interactive optimization of composite indexVisual Informatics, 2024
- Chat2VIS: Generating Data Visualizations via Natural Language Using ChatGPT, Codex and GPT-3 Large Language ModelsIEEE Access, 2023
- Interactive Cleaning for Progressive Visualization through Composite Questions2020
- The Factor Structure of the System Usability Scale2009
- A critical review of the literature on spreadsheet errorsDecision Support Systems, 2008
- Automatic outlier detection for time series: an application to sensor dataKnowledge and Information Systems, 2006
- Outlier Detection2006
- Approximate inference of functional dependencies from relationsTheoretical Computer Science, 1995