Hui Lu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Hui Lu has a total of 48 co-authors. Here are the top co-authors by number of shared publications:
- Yuchao Zheng
ByteDance, Hangzhou, China
6 shared publications - Zheng Chai
ByteDance, Hangzhou, China
5 shared publications - Peng Xu
Bytedance, San Jose, USA
3 shared publications - Di Chen
Bytedance, Beijing, China
2 shared publications - Di Wu
Bytedance, Beijing, China
2 shared publications - Huizhi Yang
Bytedance, Beijing, China
2 shared publications
Latest Publications
- Open Access
- 8 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 7489-7500
TokenMixer-Large: Scaling Up Large Ranking Models in Industrial Recommenders
While scaling laws for recommendation models have gained significant traction, existing architectures such as Wukong, HiFormer, and DHEN often struggle with sub-optimal designs and hardware under-utilization, limiting their practical scalability. Our previous TokenMixer architecture (introduced in the RankMixer paper) balanced effectiveness and efficiency by replacing self-attention with a lightweight token mixing operator; however, it encountered critical bottlenecks in deeper configurations, including sub-optimal residual paths, vanishing gradients, incomplete MoE sparsification, and constrained scalability. In this paper, we propose TokenMixer-Large, a systematically evolved architecture designed for extreme-scale recommendation. By introducing a mixing-and-reverting operation, inter-layer residuals, and an auxiliary loss, we ensure stable gradient propagation as model depth increases. Furthermore, we incorporate a Sparse Per-token MoE to enable efficient parameter expansion. TokenMixer-Large successfully scales to 7 billion parameters for online traffic and 15 billion in offline experiments. Currently deployed in multiple scenarios at ByteDance, TokenMixer-Large has achieved substantial performance gains: delivering a 1.66% increase in orders and a 2.98% boost in per-capita preview payment GMV for e-commerce; improving ADSS by 2.0% in advertising; and achieving 1.4% revenue growth in live streaming.
- 8 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 7489-7500
Open AccessTokenMixer-Large: Scaling Up Large Ranking Models in Industrial Recommenders
While scaling laws for recommendation models have gained significant traction, existing architectures such as Wukong, HiFormer, and DHEN often struggle with sub-optimal designs and hardware under-utilization, limiting their practical scalability. Our previous TokenMixer architecture (introduced in the RankMixer paper) balanced effectiveness and efficiency by replacing self-attention with a lightweight token mixing operator; however, it encountered critical bottlenecks in deeper configurations, including sub-optimal residual paths, vanishing gradients, incomplete MoE sparsification, and constrained scalability. In this paper, we propose TokenMixer-Large, a systematically evolved architecture designed for extreme-scale recommendation. By introducing a mixing-and-reverting operation, inter-layer residuals, and an auxiliary loss, we ensure stable gradient propagation as model depth increases. Furthermore, we incorporate a Sparse Per-token MoE to enable efficient parameter expansion. TokenMixer-Large successfully scales to 7 billion parameters for online traffic and 15 billion in offline experiments. Currently deployed in multiple scenarios at ByteDance, TokenMixer-Large has achieved substantial performance gains: delivering a 1.66% increase in orders and a 2.98% boost in per-capita preview payment GMV for e-commerce; improving ADSS by 2.0% in advertising; and achieving 1.4% revenue growth in live streaming.
- Open Access
- 8 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 8258-8266
MSN: A Memory-based Sparse Activation Scaling Framework for Large-scale Industrial Recommendation
- 8 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 8258-8266
Open AccessMSN: A Memory-based Sparse Activation Scaling Framework for Large-scale Industrial Recommendation
- Top Cited PapersOpen Access
- 22 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 247-256
LONGER: Scaling Up Long Sequence Modeling in Industrial Recommenders
- 22 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 247-256
Top Cited PapersOpen AccessLONGER: Scaling Up Long Sequence Modeling in Industrial Recommenders
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 4234-4238
Adaptive Domain Scaling for Personalized Sequential Modeling in Recommenders
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 4234-4238
Open AccessAdaptive Domain Scaling for Personalized Sequential Modeling in Recommenders
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 4380-4384
Pyramid Mixer: Multi-dimensional Multi-period Interest Modeling for Sequential Recommendation
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 4380-4384
Open AccessPyramid Mixer: Multi-dimensional Multi-period Interest Modeling for Sequential Recommendation
- Open Access
- 8 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 1162-1166
Large Memory Network for Recommendation
- 8 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 1162-1166
Open AccessLarge Memory Network for Recommendation