Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers
Authors:
- Jiawen XieJXJiawen Xie
- Xiao LiangXLXiao Liang
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 13500-13519
Abstract
Jiawen Xie, Pengyu Cheng, Xiao Liang, Yong Dai, Nan Du. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- A Practical Survey on Faster and Lighter TransformersACM Computing Surveys, 2023
- Efficient Long-Text Understanding with Short-Text ModelsTransactions of the Association for Computational Linguistics, 2023
- Transformers and the Representation of Biomedical Background KnowledgeComputational Linguistics, 2023
- Multi-document Summarization via Deep Learning Techniques: A SurveyACM Computing Surveys, 2022
- Efficient Content-Based Sparse Attention with Routing TransformersTransactions of the Association for Computational Linguistics, 2021
- On Faithfulness and Factuality in Abstractive Summarization2020
- A Large-Scale Multi-Document Summarization Dataset from the Wikipedia Current Events Portal2020
- Natural Questions: A Benchmark for Question Answering ResearchTransactions of the Association for Computational Linguistics, 2019
- The NarrativeQA Reading Comprehension ChallengeTransactions of the Association for Computational Linguistics, 2018
- The locality principleCommunications of the ACM, 2005