In-Context Learning Creates Task Vectors
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 9318-9333
Abstract
Roee Hendel, Mor Geva, Amir Globerson. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Language Models Implement Simple Word2Vec-style Vector Arithmetic2024
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing Surveys, 2023
- Analyzing Transformers in Embedding Space2023
- Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers2023
- The Power of Scale for Parameter-Efficient Prompt Tuning2021