The 2024 GEM Shared Task on Multilingual Data-to-Text Generation and Summarization: Overview and Preliminary Results
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 17-38
Abstract
Simon Mille, João Sedoc, Yixin Liu, Elizabeth Clark, Agnes Johanna Axelsson, Miruna Adriana Clinciu, Yufang Hou, Saad Mahamood, Ishmael Nyunya Obonyo, Lining Zhang. Proceedings of the 17th International Natural Language Generation Conference: Generation Challenges. 2024.Keywords
This publication has 10 references indexed in Scilit:
- On the Role of Summary Content Units in Text Summarization Evaluation2024
- Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated TextJournal of Artificial Intelligence Research, 2023
- Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation2023
- Optimal Reliability and Validity of Measurement Model in Confirmatory Factor Analysis: Different Likert Point Scale ExperimentJournal of Contemporary Issues and Thought, 2021
- Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cards2021
- XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages2021
- Preregistering NLP research2021
- Disentangling the Properties of Human Evaluation Methods: A Classification System to Support Comparability, Meta-Evaluation and Reproducibility Testing2020
- Evaluating the state-of-the-art of End-to-End Natural Language Generation: The E2E NLG challengeComputer Speech & Language, 2020
- The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results2018