Many-to-Many Multilingual Translation Model for Languages of Indonesia
Top Cited Papers
Open Access
- 25 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 91385-91397
Abstract
Indonesia is home to over 700 languages and most people speak their respective regional languages aside from the lingua franca. In this paper, we focus on the task of multilingual machine translation for 45 regional Indonesian languages and introduced Indo-T5 which leveraged the mT5 sequence-to-sequence language model as a baseline. Performances of bilingual and multilingual fine-tuning methods were also compared, in which we found that our models have outperformed current state-of-the-art translation models. We also investigate the use of religious texts from the Bible as an intermediate mid-resource translation domain for low-resource translation domain specialization. Our findings suggest that this two-step fine-tuning approach is highly effective in improving the quality of translations for low-resource text domains. Our results show an increase in SacreBLEU scores when evaluated on the low-resource NusaX dataset. We release our translation models for other researchers to leverage.Keywords
Funding Information
- Binus University
This publication has 20 references indexed in Scilit:
- Multilingual Denoising Pre-training for Neural Machine TranslationTransactions of the Association for Computational Linguistics, 2020
- Transformers: State-of-the-Art Natural Language Processing2020
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension2020
- Unsupervised Cross-lingual Representation Learning at Scale2020
- The FLORES Evaluation Datasets for Low-Resource Machine Translation: Nepali–English and Sinhala–English2019
- Massively Multilingual Neural Machine Translation2019
- Dialect and Identity: A Case Study of Javanese Use in WhatsApp and LineIOP Conference Series: Earth and Environmental Science, 2018
- Marian: Fast Neural Machine Translation in C++2018
- A Call for Clarity in Reporting BLEU Scores2018
- BLEU2001