LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
Open Access
- 22 March 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1055-1072
Abstract
No abstract availableAll Related Versions
This publication has 12 references indexed in Scilit:
- LLM-Based Agents for Tool Learning: A SurveyData Science and Engineering, 2025
- A Survey on Mixture of Experts in Large Language ModelsIEEE Transactions on Knowledge and Data Engineering, 2025
- AI Computing Systems for Large Language Models TrainingJournal of Computer Science and Technology, 2025
- MoESys: A Distributed and Efficient Mixture-of-Experts Training and Inference System for Internet ServicesIEEE Transactions on Services Computing, 2024
- Advances of Pipeline Model Parallelism for Deep Learning Training: An OverviewJournal of Computer Science and Technology, 2024
- Improving Automatic Parallel Training via Balanced Memory Workload OptimizationIEEE Transactions on Knowledge and Data Engineering, 2024
- DB-GPT: Large Language Model Meets DatabaseData Science and Engineering, 2024
- FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device PlacementProceedings of the ACM on Management of Data, 2023
- ZeRO: Memory optimizations Toward Training Trillion Parameter Models2020
- PipeDream2019