Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation
Authors:
- Tom KocmiTKTom Kocmi
- Vilém ZouharVZVilém Zouhar
- Roman GrundkiewiczRGRoman Grundkiewicz
Top Cited Papers
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 1440-1453
Abstract
Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popović, Mrinmaya Sachan, Mariya Shmatova. Proceedings of the Ninth Conference on Machine Translation. 2024.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Calibration and context in human evaluation of machine translationNatural Language Processing, 2024
- Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent2023
- Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet2023
- Two Contrasting Data Annotation Paradigms for Subjective NLP Tasks2022
- Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine TranslationTransactions of the Association for Computational Linguistics, 2021
- Informative Manual Evaluation of Machine Translation Output2020
- Quantitative fine-grained human evaluation of machine translation systems: a case study on English to CroatianMachine Translation, 2018
- Findings of the 2017 Conference on Machine Translation (WMT17)2017
- Findings of the 2016 Conference on Machine Translation2016