Tied-LoRA: Enhancing parameter efficiency of LoRA with Weight Tying
Top Cited Papers
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 8694-8705
Abstract
Adithya Renduchintala, Tugrul Konuk, Oleksii Kuchaiev. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models2022
- AdapterFusion: Non-Destructive Task Composition for Transfer Learning2021
- Prefix-Tuning: Optimizing Continuous Prompts for Generation2021
- DialogSum: A Real-Life Scenario Dialogue Summarization Dataset2021
- HellaSwag: Can a Machine Really Finish Your Sentence?2019
- SQuAD: 100,000+ Questions for Machine Comprehension of Text2016
- Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics2004
- BLEU2001