Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering
Authors:
- Thomas ScialomTSThomas Scialom
- Rachel KeraronRKRachel Keraron
- Djamé SeddahDSDjamé Seddah
- Jacopo StaianoJSJacopo Staiano
Preprint
Abstract
Coupled with the availability of large scale datasets, deep learning architectures have enabled rapid progress on the Question Answering task. However, most of those datasets are in English, and the performances of state-of-the-art multilingual models are significantly lower when evaluated on non-English data. Due to high data collection costs, it is not realistic to obtain annotated data for each language one desires to support. We propose a method to improve the Cross-lingual Question Answering performance without requiring additional annotated data, leveraging Question Generation models to produce synthetic samples in a cross-lingual fashion. We show that the proposed method allows to significantly outperform the baselines trained on English data only. We report a new state-of-the-art on four multilingual datasets: MLQA, XQuAD, SQuAD-it and PIAF (fr).Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- ANTIQUE: A Non-factoid Question Answering Benchmark2020
- Cross-Lingual Natural Language Generation via Pre-TrainingProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Toward Stance-based Personas for Opinionated Dialogues2020
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension2020
- CamemBERT: a Tasty French Language Model2020
- Unsupervised Cross-lingual Representation Learning at Scale2020
- MLQA: Evaluating Cross-lingual Extractive Question Answering2020
- On the Cross-lingual Transferability of Monolingual Representations2020
- Natural Questions: A Benchmark for Question Answering ResearchTransactions of the Association for Computational Linguistics, 2019
- The NarrativeQA Reading Comprehension ChallengeTransactions of the Association for Computational Linguistics, 2018