MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning
Authors:
Top Cited Papers
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 4823-4836
Abstract
Hanqing Wang, Yixia Li, Shuo Wang, Guanhua Chen, Yun Chen. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- LoRA-GA: Low-Rank Adaptation with Gradient Approximation2024
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations2024
- LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks2024
- LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin2024
- A-OKVQA: A Benchmark for Visual Question Answering Using World Knowledge2022
- Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models2022
- Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning2021
- Social IQa: Commonsense Reasoning about Social Interactions2019
- Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering2018
- Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image AnnotationsInternational Journal of Computer Vision, 2017