Do Before You Judge: Self-Reference as a Pathway to Better LLM Evaluation
Authors:
- Wei-Hsiang LinWLWei-Hsiang Lin
- Sheng-Lun WeiSWSheng-Lun Wei
- Hen-Hsen HuangHHHen-Hsen Huang
- Hsin-Hsi ChenHCHsin-Hsi Chen
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 24651-24672
Abstract
Wei-Hsiang Lin, Sheng-Lun Wei, Hen-Hsen Huang, Hsin-Hsi Chen. Findings of the Association for Computational Linguistics: EMNLP 2025. 2025.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- LawBench: Benchmarking Legal Knowledge of Large Language Models2024
- Humans or LLMs as the Judge? A Study on Judgement Bias2024
- Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessment2024
- Unveiling Selection Biases: Exploring Order and Token Sensitivity in Large Language Models2024
- Benchmarking Cognitive Biases in Large Language Models as Evaluators2024
- ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs2024
- Large Language Models are not Fair Evaluators2024
- Aligning Large Language Models by On-Policy Self-Judgment2024
- OceanGPT: A Large Language Model for Ocean Science Tasks2024
- LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Models2023