Weiran He
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Weiran He has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Feng Ren
Computer Science and Technology, Tsinghua University
1 shared publication - Heyi Tang
Tsinghua University, Beijing, China
1 shared publication - Jialei Cui
Moonshot AI
1 shared publication - Mingxing Zhang
Tsinghua University, Beijing, China
1 shared publication - Ruoyu Qin
Computer Science and Technology, Tsinghua University
1 shared publication - Shangming Cai
Alibaba Group, Hangzhou, Zhejiang, China
1 shared publication
Latest Publications
- Top Cited PapersOpen Access
- 15 November 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 22 (4) , 1-38
Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
Mooncake is the serving platform for Kimi, an LLM chatbot service developed by Moonshot AI. This platform features a KVCache-centric disaggregated architecture that not only separates prefill and decoding clusters but also efficiently utilizes the underexploited CPU, DRAM, SSD and NIC resources of the GPU cluster to establish a disaggregated KVCache. At the core of Mooncake is its KVCache-centric global cache and a scheduler designed to maximize throughput while adhering to stringent latency-related Service Level Objectives (SLOs). Our experiments demonstrate that Mooncake excels in scenarios involving long-context inputs. In tests using real traces, Mooncake increases the effective request capacity by 59% ∼ 498% when compared to baseline methods, all while complying with SLOs. Currently, Mooncake is operational across thousands of nodes, processing over 100 billion tokens daily. In practical deployments, Mooncake ’s innovative architecture enables Kimi to handle 115% and 107% more requests on NVIDIA A800 and H800 clusters, respectively, compared to previous systems.
- 15 November 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 22 (4) , 1-38
Top Cited PapersOpen AccessMooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
Mooncake is the serving platform for Kimi, an LLM chatbot service developed by Moonshot AI. This platform features a KVCache-centric disaggregated architecture that not only separates prefill and decoding clusters but also efficiently utilizes the underexploited CPU, DRAM, SSD and NIC resources of the GPU cluster to establish a disaggregated KVCache. At the core of Mooncake is its KVCache-centric global cache and a scheduler designed to maximize throughput while adhering to stringent latency-related Service Level Objectives (SLOs). Our experiments demonstrate that Mooncake excels in scenarios involving long-context inputs. In tests using real traces, Mooncake increases the effective request capacity by 59% ∼ 498% when compared to baseline methods, all while complying with SLOs. Currently, Mooncake is operational across thousands of nodes, processing over 100 billion tokens daily. In practical deployments, Mooncake ’s innovative architecture enables Kimi to handle 115% and 107% more requests on NVIDIA A800 and H800 clusters, respectively, compared to previous systems.