Audio-Based Crowd-Sourced Evaluation of Machine Translation Quality
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 52-63
Abstract
Sami Haq, Sheila Castilho, Yvette Graham. Proceedings of the Tenth Conference on Machine Translation. 2025.Keywords
This publication has 9 references indexed in Scilit:
- Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation2024
- Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation2024
- Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet2023
- Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine TranslationTransactions of the Association for Computational Linguistics, 2021
- Choice of Voices2020
- Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation2018
- Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation2018
- Can machine translation systems be evaluated by the crowd aloneNatural Language Engineering, 2015
- Task Requirements and Media Choice in Collaborative WritingHuman–Computer Interaction, 1992