$S^3$: Increasing GPU Utilization during Generative Inference for Higher Throughput
Authors:
- Yunho JinYJYunho Jin
- Chun-Feng WuCWChun-Feng Wu
- David BrooksDBDavid Brooks
- Gu-Yeon WeiGWGu-Yeon Wei
- 1 January 2023
- conference paper
- Published by Curran Associates, Inc.
- p. 18015-18027