Real-World Summarization: When Evaluation Reaches Its Limits
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 25014-25026
Abstract
Patrícia Schmidtová, Ondrej Dusek, Saad Mahamood. Findings of the Association for Computational Linguistics: EMNLP 2025. 2025.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- We Should Evaluate Real-World ImpactComputational Linguistics, 2025
- Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated TextJournal of Artificial Intelligence Research, 2023
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors2023
- A Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for Summarization2023
- AlignScore: Evaluating Factual Consistency with A Unified Alignment Function2023
- Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation2022
- Language-agnostic BERT Sentence Embedding2022
- Evaluating Semantic Accuracy of Data-to-Text Generation with Natural Language Inference2020
- On Faithfulness and Factuality in Abstractive Summarization2020