$S^3$: Increasing GPU Utilization during Generative Inference for Higher Throughput

Authors:
  • YJYunho Jin
    Yunho Jin
  • CWChun-Feng Wu
    Chun-Feng Wu
  • DBDavid Brooks
    David Brooks
  • GWGu-Yeon Wei
    Gu-Yeon Wei

Abstract
No abstract available