An Integrated Approach to Adapting Open-Source AI Models for Machine Translation of Low-Resource Turkic Languages
Top Cited Papers
Open Access
Abstract
This study presents the application of free, open-source artificial intelligence (AI) techniques to advance machine translation for low-resource Turkic languages such as Kazakh, Azerbaijani, Kyrgyz, Turkish, Turkmen, and Uzbek. This machine translation problem for Turkic languages is part of a project to generate meeting minutes from speech transcripts. Due to limited parallel corpora and underdeveloped linguistic tools for these languages, traditional machine translation approaches often underperform. The goal is to reduce digital inequality for these languages and to support scalability. We investigate the effectiveness of free open-source pre-trained specialized and general-purpose AI models for morphologically rich state Turkic languages. This research includes developing parallel corpora for six Turkic languages, fine-tuning, and performance evaluation using BLEU, WER, TER, and chrF metrics. The parallel corpora for five pair languages, each of 300,000 and 500,000 sentences, were generated and cleaned. The results for corpora 500,000 parallel sentences show significant improvements compared with baseline NLLB-200 1.3B on average: BLEU increased by 23.81 points, chrF increased by 26.05 points, and WER and TER decreased by 0.36 and 33.95, respectively, after cleaning and fine-tuning. Six Turkic-language multilingual parallel corpora of 3 885 542 sentences were developed and the fine-tuning of NLLB-200 1.3B shows the following, compared with the results for 500,000 cleaned corpus: BLEU increased by 4.3 points, chrF increased by 1.7 points, and WER and TER decreased by 0.1 and 4.75, respectively These results demonstrate the high efficiency of corpus cleaning and synthetic data generation to improve the quality of machine translation for low-resource Turkic languages using AI models. These results were confirmed by external evaluation on the FLORES 200 dataset and human evaluation. The scientific contribution of this article is the development of a methodology for generating parallel corpora using a specialized AI model of machine translation and fine-tuning the specialized AI model on the created corpora, creating new multilingual parallel corpora of Azerbaijan–Kazakh, Kyrgyz–Kazakh, Turkish–Kazakh, Turkmen–Kazakh, and Uzbek–Kazakh pairs using the proposed methodology, cleaning them, and conducting fine-tuning experiments.Keywords
Funding Information
- the Ministry of Science and Higher Education of the Republic of Kazakhstan (AP23487816)
This publication has 23 references indexed in Scilit:
- Improving Low-Resource Kazakh-English and Turkish-English Neural Machine Translation Using Transfer Learning and Part of Speech TagsIEEE Access, 2025
- Multilingual end-to-end ASR for low-resource Turkic languages with common alphabetsScientific Reports, 2024
- Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine TranslationTransactions of the Association for Computational Linguistics, 2021
- A Large-Scale Study of Machine Translation in Turkic Languages2021
- Neural Machine Translation: A ReviewJournal of Artificial Intelligence Research, 2020
- Neural machine translation: Challenges, progress and futureScience China Technological Sciences, 2020
- COMET: A Neural Framework for MT Evaluation2020
- BLEURT: Learning Robust Metrics for Text Generation2020
- Agglutinative Language Speech Recognition Using Automatic Allophone DerivingChinese Journal of Electronics, 2016
- Dependency Parsing of TurkishComputational Linguistics, 2008