∞Bench: Extending Long Context Evaluation Beyond 100K Tokens
Authors:
- Moo HaoMHMoo Hao
Top Cited Papers
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 15262-15277
Abstract
Xinrong Zhang, Yingfa Chen, Shengding Hu, Zihang Xu, Junhao Chen, Moo Hao, Xu Han, Zhen Thai, Shuo Wang, Zhiyuan Liu, Maosong Sun. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding2024
- LooGLE: Can Long-Context Language Models Understand Long Contexts?2024
- L-Eval: Instituting Standardized Evaluation for Long Context Language Models2024
- S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model2024
- RoFormer: Enhanced transformer with Rotary Position EmbeddingNeurocomputing, 2023
- Pre-trained models: Past, present and futureAI Open, 2021
- Pre-trained models for natural language processing: A surveyScience China Technological Sciences, 2020
- The NarrativeQA Reading Comprehension ChallengeTransactions of the Association for Computational Linguistics, 2018
- Long Short-Term MemoryNeural Computation, 1997