M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 15568-15592
Abstract
Wai-Chung Kwan, Xingshan Zeng, Yufei Wang, Yusen Sun, Liangyou Li, Yuxin Jiang, Lifeng Shang, Qun Liu, Kam-Fai Wong. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models2024
- ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding2023
- A Length-Extrapolatable Transformer2023
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them2023
- CLTS+: A New Chinese Long Text Summarization Dataset with Abstractive Summaries2022
- SCROLLS: Standardized CompaRison Over Long Language Sequences2022
- Do Long-Range Language Models Actually Use Long-Range Context?2021
- CLTS: A New Chinese Long Text Summarization Dataset2020
- Aspect-Aware Multimodal Summarization for Chinese E-Commerce ProductsProceedings of the AAAI Conference on Artificial Intelligence, 2020
- The Multilingual Amazon Reviews Corpus2020