The Glass Ceiling of Automatic Evaluation in Natural Language Generation
Authors:
Top Cited Papers
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 178-183
Abstract
Pierre Colombo, Maxime Peyrard, Nathan Noiry, Robert West, Pablo Piantanida. Findings of the Association for Computational Linguistics: IJCNLP-AACL 2023 (Findings). 2023.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Better than Average: Paired Evaluation of NLP systems2021
- An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformers2021
- Re-evaluating Evaluation in Text Summarization2020
- USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation2020
- Why We Need New Evaluation Metrics for NLG2017
- Better Summarization Evaluation with Word Embeddings for ROUGE2015
- Re-evaluating Automatic Summarization with BLEU and 192 Shades of ROUGE2015
- From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptionsTransactions of the Association for Computational Linguistics, 2014
- Experiments with Kemeny ranking: What works when?Mathematical Social Sciences, 2012
- The computational difficulty of manipulating an electionSocial Choice and Welfare, 1989