ApiQ: Finetuning of 2-Bit Quantized Large Language Model

Authors:

Abstract
Baohao Liao, Christian Herold, Shahram Khadivi, Christof Monz. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.