MiniCache: KV Cache Compression in Depth Dimension for Large Language Models
Authors:
- Akide LiuALAkide Liu
- Jing LiuJLJing Liu
- Zizheng PanZPZizheng Pan
- Yefei HeYHYefei He
- Gholamreza HaffariGHGholamreza Haffari
- Bohan ZhuangBZBohan Zhuang
Top Cited Papers
- 1 January 2024
- conference paper
- Published by Curran Associates, Inc.
- p. 139997-140031