Generating Benchmarks for Factuality Evaluation of Language Models
Authors:
Top Cited Papers
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 49-66
Abstract
Dor Muhlgay, Ori Ram, Inbal Magar, Yoav Levine, Nir Ratner, Yonatan Belinkov, Omri Abend, Kevin Leyton-Brown, Amnon Shashua, Yoav Shoham. Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Measuring and Improving Consistency in Pretrained Language ModelsTransactions of the Association for Computational Linguistics, 2021
- Are Factuality Checkers Reliable? Adversarial Meta-evaluation of Factuality in Summarization2021
- KILT: a Benchmark for Knowledge Intensive Language Tasks2021
- Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics2021
- How Can We Know What Language Models Know?Transactions of the Association for Computational Linguistics, 2020
- Challenges in Building Intelligent Open-domain Dialog SystemsACM Transactions on Information Systems, 2020
- How Much Knowledge Can You Pack Into the Parameters of a Language Model?2020
- Dense Passage Retrieval for Open-Domain Question Answering2020
- On Faithfulness and Factuality in Abstractive Summarization2020
- The Probabilistic Relevance Framework: BM25 and BeyondFoundations and Trends® in Information Retrieval, 2009