Harnessing Google Translations to Develop a Readability Corpus for Sesotho: An Exploratory Study
Open Access
- 16 February 2024
- journal article
- research article
- Published by Digital Humanities Association of Southern Africa
- Vol. 5 (1)
Abstract
This article addresses the scarcity of gold-standard annotated corpora for readability assessment in Sesotho, a low-resource language. As a solution, we propose using translated texts to construct a readability-labelled corpus. Specifically, we investigate the feasibility of using Google Translate to translate texts from Sesotho to English and then manually post-editing the texts. We then evaluate the effectiveness of the Google translations by comparing them to the human-post-edited versions. We utilised the Ghent University readability demo to extract the readability levels of both the Google translations and the human-post-edited translations. The translations are then evaluated using three evaluation metrics, namely, BLEU, NIST, and RIBES scores. The translation evaluation results reveal substantial similarities between the machine translations and the corresponding human-post-edited texts. Moreover, the results of the readability assessment and the comparison of text properties demonstrate a high level of consistency between machine translations and human-post-edited texts. These findings suggest that Google Translations show promise in addressing challenges in developing readability-labelled parallel datasets in low-resource languages like Sesotho, highlighting the potential of leveraging machine translation techniques to develop translated corpora for such languages. The evaluation of Google Translations in the context of educational texts in Sesotho and the demonstration of the feasibility and potential of using machine translations for enhancing readability in Sesotho will aid in the quest for developing Sesotho text readability measures.Keywords
This publication has 27 references indexed in Scilit:
- AdaBLEU: A Modified BLEU Score for Morphologically Rich LanguagesIETE Journal of Research, 2021
- The effectiveness of machine translation to improve the system of translating language on cultural contextIOP Conference Series: Earth and Environmental Science, 2020
- Using google translate in EFL drafts: a preliminary investigationComputer Assisted Language Learning, 2019
- Friend or foe? Google Translate in language for academic purposesEnglish for Specific Purposes, 2015
- Enterprise web services-enabled translation frameworkInformation Systems and e-Business Management, 2010
- Machine translation evaluation versus quality estimationMachine Translation, 2010
- Using the SMOG Formula to Revise a Health-Related DocumentAmerican Journal of Health Education, 2008
- The Concept of Equivalence and the Object of Translation Studies11995
- A computer readability formula designed for machine scoring.Journal of Applied Psychology, 1975
- A new readability yardstick.Journal of Applied Psychology, 1948