Reducing Human Effort to Validate LLM Relevance Judgements via Stratified Sampling
- 25 March 2026
- book chapter
- Published by Springer Nature
- p. 418-433
Abstract
No abstract availableKeywords
This publication has 27 references indexed in Scilit:
- LLMs can be Fooled into Labelling a Document as Relevant: best café near me; this paper is perfectly relevant2024
- AI Can Be Cognitively Biased: An Exploratory Study on Threshold Priming in LLM-Based Batch Relevance Assessment2024
- Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024ACM SIGIR Forum, 2024
- Large Language Models can Accurately Predict Searcher Preferences2024
- LLM4Eval: Large Language Model for Evaluation in IR2024
- Perspectives on Large Language Models for Relevance Judgment2023
- Detecting Significant Differences Between Information Retrieval Systems via Generalized Linear Models2022
- Data Cleaning2016
- Estimating standard errors of accuracy assessment statistics under cluster samplingRemote Sensing of Environment, 1997
- The ASLIB CRANFIELD RESEARCH PROJECT ON The COMPARATIVE EFFICIENCY OF INDEXING SYSTEMSAslib Proceedings, 1960