Assessing the Role of Data Quality in Training Bilingual Language Models
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 22694-22720
Abstract
Skyler Seto, Maartje Ter Hoeve, Maureen de Seyssel, David Grangier. Findings of the Association for Computational Linguistics: EMNLP 2025. 2025.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- A survey on multilingual large language models: corpora, alignment, and biasFrontiers of Computer Science, 2025
- Multilingual Language Model Pretraining using Machine-translated Data2025
- Training Bilingual LMs with Data Constraints in the Targeted Language2025
- GottBERT: a pure German Language Model2024
- Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling2024
- On-Demand Sampling: Learning Optimally from Multiple Distributions2022
- On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment2020
- XNLI: Evaluating Cross-lingual Sentence Representations2018
- Crowdsourcing Multiple Choice Science Questions2017
- Modeling Local Coherence: An Entity-Based ApproachComputational Linguistics, 2008