DivLogicEval: A Framework for Benchmarking Logical Reasoning Evaluation in Large Language Models
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 901-915
Abstract
Tsz Ting Chung, Lemao Liu, Mo Yu, Dit-Yan Yeung. Findings of the Association for Computational Linguistics: EMNLP 2025. 2025.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- The Stochastic Parrot on LLM’s Shoulder: A Summative Assessment of Physical Concept Understanding2025
- Selection-p: Self-Supervised Task-Agnostic Prompt Compression for Faithfulness and Transferability2024
- One Thousand and One Pairs: A “novel” challenge for long-context language models2024
- Investigating Data Contamination in Modern Benchmarks for Large Language Models2024
- LogiQA 2.0—An Improved Dataset for Logical Reasoning in Natural Language UnderstandingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023
- MMBench: The Match Making Benchmark2023
- Symbol tuning improves in-context learning in language models2023
- AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension2022
- Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text2022
- Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI2021