PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 6266-6282
Abstract
Gyeongman Kim, Doohyuk Jang, Eunho Yang. Findings of the Association for Computational Linguistics: EMNLP 2024. 2024.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- The Power of Scale for Parameter-Efficient Prompt Tuning2021
- Distilling Linguistic Context for Language Model Compression2021
- Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference2021
- Prefix-Tuning: Optimizing Continuous Prompts for Generation2021
- Making Pre-trained Language Models Better Few-shot Learners2021
- WARP: Word-level Adversarial ReProgramming2021
- Factual Probing Is [MASK]: Learning vs. Learning to Recall2021
- How Can We Know What Language Models Know?Transactions of the Association for Computational Linguistics, 2020
- TinyBERT: Distilling BERT for Natural Language Understanding2020
- AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts2020