A survey of context in neural machine translation and its evaluation
Open Access
- 17 May 2024
- journal article
- research article
- Published by Cambridge University Press (CUP) in Natural Language Processing
- Vol. 31 (4) , 986-1016
Abstract
The question of context in neural machine translation often focuses on topics related to document-level translation or intersentential context. However, there is a wide range of other aspects that can be considered under the umbrella of context. In this work, we survey ways that researchers have incorporated context into neural machine translation systems and the evaluation thereof. This includes building translation systems that operate at the paragraph level or the document level or ones that translate at the sentence level but incorporate information from other sentences. We also consider how issues like terminology consistency, anaphora, and world knowledge or external information can be considered as types of context relevant to the task of machine translation and its evaluation. Closely tied to these topics is the question of how to best evaluate machine translation output in a way that is sensitive to the contexts in which it appears. To this end, we discuss work on incorporating context into both human and automatic evaluations of machine translation quality. Furthermore, we also discuss recent experiments in the field as they relate to the use of large language models in translation and evaluation. We conclude with a view of the future of machine translation, where we expect to see issues of context continue to come to the forefront.Keywords
This publication has 121 references indexed in Scilit:
- Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A SurveyJournal of Artificial Intelligence Research, 2022
- ISOMETRIC MT: Neural Machine Translation for Automatic Dubbing2022
- Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine TranslationTransactions of the Association for Computational Linguistics, 2021
- Revisiting Multi-Domain Machine TranslationTransactions of the Association for Computational Linguistics, 2021
- Multilingual Denoising Pre-training for Neural Machine TranslationTransactions of the Association for Computational Linguistics, 2020
- Better Document-Level Machine Translation with Bayes’ RuleTransactions of the Association for Computational Linguistics, 2020
- Controlling Neural Machine Translation Formality with Synthetic SupervisionProceedings of the AAAI Conference on Artificial Intelligence, 2020
- A Set of Recommendations for Assessing Human–Machine Parity in Language TranslationJournal of Artificial Intelligence Research, 2020
- Modeling Coherence for Discourse Neural Machine TranslationProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Is Neural Machine Translation the New State of the Art?The Prague Bulletin of Mathematical Linguistics, 2017