Xiang Li
Research Subjects
Xiang Li has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
- Wang Zhang
Seed, ByteDance, San Jose, USA
2 shared publications - Andrea Arpaci-Dusseau
University of Wisconsin–Madison, Madison, Wisconsin, USA
1 shared publication - Baoquan Zhong
Seed, ByteDance, Hangzhou, Zhejiang, China
1 shared publication - Borui Wan
The University of Hong Kong, Hong Kong, Hong Kong
1 shared publication - Chaobo Jia
Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, Hong Kong
1 shared publication - Chenhao Ye
University of Wisconsin–Madison, Madison, Wisconsin, USA
1 shared publication
Latest Publications
- Open Access
- 28 September 2026
- Published by Association for Computing Machinery (ACM)
- p. 882-897
TensorHub: Scalable and Elastic Weight Transfer for LLM RL Training
- 28 September 2026
- Published by Association for Computing Machinery (ACM)
- p. 882-897
Open AccessTensorHub: Scalable and Elastic Weight Transfer for LLM RL Training
- Open Access
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 400-422
Laminar: A Scalable Asynchronous RL Post-Training Framework
Reinforcement learning (RL) post-training for Large Language Models (LLMs) is now scaling to large clusters and running for extended durations to enhance model reasoning performance. However, the scalability of existing RL frameworks is limited, as extreme long-tail skewness in RL trajectory generation causes severe GPU underutilization. Current asynchronous RL systems attempt to mitigate this, but they rely on global weight synchronization between the actor and all rollouts, which creates a rigid model update schedule. This global synchronization is ill-suited for the highly skewed and evolving distribution of trajectory generation latency in RL training, crippling training efficiency. Our key insight is that efficient scaling requires breaking this lockstep through trajectory-level asynchrony, which generates and consumes each trajectory independently. We propose Laminar, a scalable and robust RL post-training system built on a fully decoupled architecture. First, we replace global updates with a tier of relay workers acting as a distributed parameter service. This enables asynchronous and fine-grained weight synchronization, allowing rollouts to pull the latest weight anytime without stalling the actor's training loop. Second, a dynamic repack mechanism consolidates long-tail trajectories onto a few dedicated rollouts, maximizing generation throughput. The fully decoupled design also isolates failures, ensuring robustness for long-running jobs. Our evaluation on a 1024–GPU cluster shows that Laminar achieves up to 5.48X training throughput speedup over state-of-the-art systems, while reducing model convergence time.
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 400-422
Open AccessLaminar: A Scalable Asynchronous RL Post-Training Framework
Reinforcement learning (RL) post-training for Large Language Models (LLMs) is now scaling to large clusters and running for extended durations to enhance model reasoning performance. However, the scalability of existing RL frameworks is limited, as extreme long-tail skewness in RL trajectory generation causes severe GPU underutilization. Current asynchronous RL systems attempt to mitigate this, but they rely on global weight synchronization between the actor and all rollouts, which creates a rigid model update schedule. This global synchronization is ill-suited for the highly skewed and evolving distribution of trajectory generation latency in RL training, crippling training efficiency. Our key insight is that efficient scaling requires breaking this lockstep through trajectory-level asynchrony, which generates and consumes each trajectory independently. We propose Laminar, a scalable and robust RL post-training system built on a fully decoupled architecture. First, we replace global updates with a tier of relay workers acting as a distributed parameter service. This enables asynchronous and fine-grained weight synchronization, allowing rollouts to pull the latest weight anytime without stalling the actor's training loop. Second, a dynamic repack mechanism consolidates long-tail trajectories onto a few dedicated rollouts, maximizing generation throughput. The fully decoupled design also isolates failures, ensuring robustness for long-running jobs. Our evaluation on a 1024–GPU cluster shows that Laminar achieves up to 5.48X training throughput speedup over state-of-the-art systems, while reducing model convergence time.