Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
Top Cited Papers
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 548-560
Abstract
Koyena Pal, Jiuding Sun, Andrew Yuan, Byron Wallace, David Bau. Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL). 2023.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- A Survey on Non-Autoregressive Generation for Neural Machine Translation and BeyondIEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
- Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of Privacy2023
- Transformer Feed-Forward Layers Are Key-Value Memories2021
- BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression2021
- Non-Autoregressive Text Generation with Pre-trained Language Models2021
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- Universal Adversarial Triggers for Attacking and Analyzing NLP2019
- Finding structure in timeCognitive Science, 1990