Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models
Authors:
Top Cited Papers
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 15339-15353
Abstract
Mosh Levy, Alon Jacoby, Yoav Goldberg. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Generative Models as a Complex Systems Science: How Can We Make Sense of Large Language Model Behavior?Journal of Social Computing, 2025
- LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding2024
- LooGLE: Can Long-Context Language Models Understand Long Contexts?2024
- L-Eval: Instituting Standardized Evaluation for Long Context Language Models2024
- The Impact of Reasoning Step Length on Large Language Models2024
- Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?2023
- ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding2023
- Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks2023
- Training Trajectories of Language Models Across Scales2023