BurstGPT: A Real-World Workload Dataset to Optimize LLM Serving Systems
Top Cited Papers
Open Access
- 3 August 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 5831-5841
Abstract
No abstract availableFunding Information
- Hong Kong RIF grant (R6021-20)
- Hong Kong CRF grants (C2004-21G, C7004-22G)
- National Natural Science Foundation of China (62272122)
This publication has 15 references indexed in Scilit:
- vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention2025
- Splitwise: Efficient Generative LLM Inference Using Phase Splitting2024
- SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification2024
- SpotServe: Serving Generative Large Language Models on Preemptible Instances2024
- ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference2024
- Training and Serving System of Foundation Models: A Comprehensive SurveyIEEE Open Journal of the Computer Society, 2024
- Efficient Memory Management for Large Language Model Serving with PagedAttention2023
- Faster and Cheaper Serverless Computing on Harvested Resources2021
- DeepSpeed2020
- XGBoost2016