Efficient LLM Scheduling by Learning to Rank
Authors:
- Yichao FuYFYichao Fu
- Aurick QiaoAQAurick Qiao
- Ion StoicaISIon Stoica
- Runlong SuRSRunlong Su
- Hao ZhangHZHao Zhang
- Siqi ZhuSZSiqi Zhu
- 1 January 2024
- conference paper
- Published by Curran Associates, Inc.
- p. 59006-59029