Wei-Hsiang Lin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Wei-Hsiang Lin has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Hen-Hsen Huang
Institute of Information Science Academia Sinica Taiwan
2 shared publications - Hsin-Hsi Chen
Department of Computer Science and Information Engineering National Taiwan University Taiwan
2 shared publications Sheng-Lun Wei
2 shared publications
Latest Publications
- Open Access
Do Before You Judge: Self-Reference as a Pathway to Better LLM Evaluation
LLM-as-Judge frameworks are increasingly popular for AI evaluation, yet research findings on the relationship between models' generation and judgment abilities remain inconsistent. We investigate this relationship through systematic dataset- and instance-level analyses across 11 models and 21 diverse tasks. Despite both capabilities relying on the same underlying knowledge, our analyses reveal they are only weakly correlated, primarily due to LLMs' sensitivity to the responses being judged. To address this, we propose a self-reference-guided evaluation strategy that leverages a model's own answers as references. This approach significantly strengthens the correlation between generation and judgment abilities, offering a practical path to align these skills and providing a reliable proxy for model selection in evaluation tasks.
Open AccessDo Before You Judge: Self-Reference as a Pathway to Better LLM Evaluation
LLM-as-Judge frameworks are increasingly popular for AI evaluation, yet research findings on the relationship between models' generation and judgment abilities remain inconsistent. We investigate this relationship through systematic dataset- and instance-level analyses across 11 models and 21 diverse tasks. Despite both capabilities relying on the same underlying knowledge, our analyses reveal they are only weakly correlated, primarily due to LLMs' sensitivity to the responses being judged. To address this, we propose a self-reference-guided evaluation strategy that leverages a model's own answers as references. This approach significantly strengthens the correlation between generation and judgment abilities, offering a practical path to align these skills and providing a reliable proxy for model selection in evaluation tasks.
- Open Access
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 24651-24672
Do Before You Judge: Self-Reference as a Pathway to Better LLM Evaluation
Wei-Hsiang Lin, Sheng-Lun Wei, Hen-Hsen Huang, Hsin-Hsi Chen. Findings of the Association for Computational Linguistics: EMNLP 2025. 2025.
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 24651-24672
Open AccessDo Before You Judge: Self-Reference as a Pathway to Better LLM Evaluation
Wei-Hsiang Lin, Sheng-Lun Wei, Hen-Hsen Huang, Hsin-Hsi Chen. Findings of the Association for Computational Linguistics: EMNLP 2025. 2025.