Better Quality Pre-training Data and T5 Models for African Languages
Top Cited Papers
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 158-168
Abstract
Akintunde Oladipo, Mofetoluwa Adeyemi, Orevaoghene Ahia, Abraham Owodunni, Odunayo Ogundepo, David Adelani, Jimmy Lin. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.Keywords
This publication has 9 references indexed in Scilit:
- Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models2023
- ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte ModelsTransactions of the Association for Computational Linguistics, 2022
- Quality at a Glance: An Audit of Web-Crawled Multilingual DatasetsTransactions of the Association for Computational Linguistics, 2022
- XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages2021
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer2021
- Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus2020
- Unsupervised Cross-lingual Representation Learning at Scale2020
- JW300: A Wide-Coverage Parallel Corpus for Low-Resource Languages2019
- The Bible as a Parallel Corpus: Annotating the ‘Book of 2000 Tongues’Computers and the Humanities, 1999