Building Neural Machine Translation Systems for Multilingual Participatory Spaces
Top Cited Papers
Open Access
Abstract
This work presents the development of the translation component in a multistage, multilevel, multimode, multilingual and dynamic deliberative (M4D2) system, built to facilitate automated moderation and translation in the languages of five European countries: Italy, Ireland, Germany, France and Poland. Two main topics were to be addressed in the deliberation process: (i) the environment and climate change; and (ii) the economy and inequality. In this work, we describe the development of neural machine translation (NMT) models for these domains for six European languages: Italian, English (included as the second official language of Ireland), Irish, German, French and Polish. As a result, we generate 30 NMT models, initially baseline systems built using freely available online data, which are then adapted to the domains of interest in the project by (i) filtering the corpora, (ii) tuning the systems with automatically extracted in-domain development datasets and (iii) using corpus concatenation techniques to expand the amount of data available. We compare our results produced by the domain-adapted systems with those produced by Google Translate, and demonstrate that fast, high-quality systems can be produced that facilitate multilingual deliberation in a secure environment.Keywords
Funding Information
- European Commission (959234, 13/RC/2106_P2)
- Science Foundation Ireland (959234, 13/RC/2106_P2)
This publication has 17 references indexed in Scilit:
- fairseq: A Fast, Extensible Toolkit for Sequence Modeling2019
- Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation2018
- Marian: Fast Neural Machine Translation in C++2018
- Translation Quality Assessment2018
- Making sense of neural machine translationCorpus-Based Research in Legal and Institutional Translation, 2017
- Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot TranslationTransactions of the Association for Computational Linguistics, 2017
- OpenNMT: Open-Source Toolkit for Neural Machine Translation2017
- Neural Machine Translation of Rare Words with Subword Units2016
- On the Properties of Neural Machine Translation: Encoder–Decoder Approaches2014
- BLEU2001