Dialect-Agnostic SQL Parsing via LLM-Based Segmentation
Open Access
- 18 May 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Management of Data
- Vol. 4 (3) , 1-28
Abstract
SQL is a widely adopted language for querying data, which has led to the development of various SQL analysis and rewriting tools. However, due to the diversity of SQL dialects, such tools often fail when encountering unrecognized dialect-specific syntax. While Large Language Models (LLMs) have shown promise in understanding SQL queries, their inherent limitations in handling hierarchical structures and hallucination risks limit their direct applicability in parsing. To address these limitations, we propose SQLFlex, a novel query rewriting framework that integrates grammar-based parsing with LLM-based segmentation to parse diverse SQL dialects robustly. Our core idea is to decompose hierarchical parsing to sequential segmentation tasks, which better aligns with the strength of LLMs and improves output reliability through validation checks. Specifically, SQLFlex uses clause-level segmentation and expression-level segmentation as two strategies that decompose elements on different levels of a query. We extensively evaluated SQLFlex on both real-world use cases and in a standalone evaluation. In SQL linting, SQLFlex outperforms SQLFluff in ANSI mode by 63.68% in F1 score while matching its dialect-specific mode performance. In test-case reduction, SQLFlex outperforms SQLess by up to 10 times in simplification rate. In the standalone evaluation, it parses 91.55% to 100% of queries across eight distinct dialects, outperforming all baseline parsers. We believe SQLFlex can serve as a foundation for many query analysis and rewriting use cases.Keywords
All Related Versions
Funding Information
- Ministry of Education - Singapore (Academic Research Fund Tier 1 (FY2023))
This publication has 48 references indexed in Scilit:
- ATM: Black-box Test Case Minimization based on Test Code Similarity and Evolutionary Search2023
- Sequence-Oriented DBMS Fuzzing2023
- Automated Grading of SQL Queries2019
- Perses2018
- Generic packet descriptions: verified parsing and pretty printing of low-level data2017
- Comparing and combining test-suite reduction and regression test selection2015
- Data generation for testing and grading SQL queriesThe VLDB Journal, 2015
- Correct-by-construction pretty-printing2013
- LL(*)2011
- Invertible syntax descriptions2010