Ar-Spider: Text-to-SQL in Arabic
Open Access
- 8 April 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1024-1030
Abstract
In Natural Language Processing (NLP), one of the most important tasks is text-to-SQL semantic parsing, which focuses on enabling users to interact with the database in a more natural manner. In recent years, text-to-SQL has made significant progress, but most were English-centric. In this paper, we introduce Ar-Spider 1, the first Arabic cross-domain text-to-SQL dataset. Due to the unique nature of the language, two major challenges have been encountered, namely schema linguistic and SQL structural challenges. In order to handle these issues and conduct the experiments, we adopt two baseline models LGESQL [4] and S2SQL [12], both of which are tested with two cross-lingual models to alleviate the effects of schema linguistic and SQL structure linking challenges. The baselines demonstrate decent single-language performance on our Arabic text-to-SQL dataset, Ar-Spider, achieving 62.48% for S2SQL and 65.57% for LGESQL, only 8.79% below the highest results achieved by the baselines when trained in English dataset. To achieve better performance on Arabic text-to-SQL, we propose the context similarity relationship (CSR) approach, which results in a significant increase in the overall performance of about 1.52% for S2SQL and 1.06% for LGESQL and closes the gap between Arabic and English languages to 7.73%.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic ParsingProceedings of the AAAI Conference on Artificial Intelligence, 2023
- Code Generation Using Machine Learning: A Systematic ReviewIEEE Access, 2022
- AdaSL: An Unsupervised Domain Adaptation framework for Arabic multi-dialectal Sequence LabelingInformation Processing & Management, 2022
- PAUQ: Text-to-SQL in Russian2022
- mRAT-SQL+GAP: A Portuguese Text-to-SQL Transformer2021
- Recent advances and challenges in task-oriented dialog systemsScience China Technological Sciences, 2020
- An Empirical Study of Pre-trained Transformers for Arabic Information Extraction2020
- A Pilot Study of Text-to-SQL Semantic Parsing for Vietnamese2020
- Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and BeyondTransactions of the Association for Computational Linguistics, 2019
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks2019