KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 5967-5985
Abstract
Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Wei Ye, Jindong Wang, Xing Xie, Yue Zhang, Shikun Zhang. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity2023
- NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark2023
- GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-Distribution Generalization Perspective2023
- Self-Instruct: Aligning Language Models with Self-Generated Instructions2023
- iEval: Interactive Evaluation Framework for Open-Domain Empathetic Chatbots2022
- TruthfulQA: Measuring How Models Mimic Human Falsehoods2022
- The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation2021
- Natural Questions: A Benchmark for Question Answering ResearchTransactions of the Association for Computational Linguistics, 2019
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Natural language question answering: the view from hereNatural Language Engineering, 2001