Bridging the Gap between Synthetic and Natural Questions via Sentence Decomposition for Semantic Parsing
Open Access
- 9 May 2023
- journal article
- research article
- Published by MIT Press in Transactions of the Association for Computational Linguistics
- Vol. 11, 367-383
Abstract
Semantic parsing maps natural language questions into logical forms, which can be executed against a knowledge base for answers. In real-world applications, the performance of a parser is often limited by the lack of training data. To facilitate zero-shot learning, data synthesis has been widely studied to automatically generate paired questions and logical forms. However, data synthesis methods can hardly cover the diverse structures in natural languages, leading to a large gap in sentence structure between synthetic and natural questions. In this paper, we propose a decomposition-based method to unify the sentence structures of questions, which benefits the generalization to natural questions. Experiments demonstrate that our method significantly improves the semantic parser trained on synthetic data (+7.9% on KQA and +8.9% on ComplexWebQuestions in terms of exact match accuracy). Extensive analysis demonstrates that our method can better generalize to natural questions with novel text expressions compared with baselines. Besides semantic parsing, our idea potentially benefits other semantic understanding tasks by mitigating the distracting structure features. To illustrate this, we extend our method to the task of sentence embedding learning, and observe substantial improvements on sentence retrieval (+13.1% for Hit@1).Keywords
This publication has 45 references indexed in Scilit:
- Query Expansion Using Word Embeddings2016
- SemEval-2016 Task 1: Semantic Textual Similarity, Monolingual and Cross-Lingual Evaluation2016
- SemEval-2015 Task 2: Semantic Textual Similarity, English, Spanish and Pilot on Interpretability2015
- A large annotated corpus for learning natural language inference2015
- Building a Semantic Parser Overnight2015
- Semantic Parsing via Paraphrasing2014
- SemEval-2014 Task 10: Multilingual Semantic Textual Similarity2014
- A Survey of Automatic Query Expansion in Information RetrievalACM Computing Surveys, 2012
- Unsupervised semantic parsing2009
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977