Hybrid Pipeline for Building Arabic Tunisian Dialect-standard Arabic Neural Machine Translation Model from Scratch
Top Cited Papers
Open Access
- 31 March 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 22 (3) , 1-21
Abstract
Deep Learning is one of the most promising technologies compared to other methods in the context of machine translation. It has been proven to achieve impressive results on large amounts of parallel data for well-endowed languages. Nevertheless, for low-resource languages such as the Arabic Dialects, Deep Learning models failed due to the lack of available parallel corpora. In this article, we present a method to create a parallel corpus to build an effective NMT model able to translate into MSA, Tunisian Dialect texts present in social networks. For this, we propose a set of data augmentation methods aiming to increase the size of the state-of-the-art parallel corpus. By evaluating the impact of this step, we noticed that it has effectively boosted both the size and the quality of the corpus. Then, using the resulted corpus, we compare the effectiveness of CNN, RNN and transformers models to translate Tunisian Dialect into MSA. Experiments show that a better translation is achieved by the transformer model with a BLEU score of 60 vs., respectively, 33.36 and 53.98 with RNN and CNN models.Keywords
This publication has 10 references indexed in Scilit:
- Neural Machine Translation from Jordanian Dialect to Modern Standard Arabic2020
- An Evaluation of Subword Segmentation Strategies for Neural Machine Translation of Morphologically Rich Languages2020
- Joey NMT: A Minimalist NMT Toolkit for Novices2019
- The Annotated Transformer2018
- Self-Attention with Relative Position Representations2018
- Translating Dialectal Arabic as Low Resource Language using Word Embedding2017
- OpenNMT: Open-Source Toolkit for Neural Machine Translation2017
- Automation of understanding textual contents in social networks2016
- Statistical Framework with Knowledge Base Integration for Robust Speech Understanding of the Tunisian DialectIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Domain and Dialect Adaptation for Machine Translation into Egyptian Arabic2014