Optimizing All-to-All Collective Communication with Fault Tolerance on Torus Networks
Open Access
- 17 October 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 659-674
Abstract
No abstract availableFunding Information
- National Natural Science Foundation of China (62402411)
- Guangdong Provincial Project (2023QN10X252)
This publication has 43 references indexed in Scilit:
- Rail-only: A Low-Cost High-Performance Network for Training LLMs with Trillion Parameters2024
- A Visual Guide to MPI All-to-all2022
- Adaptive and Hierarchical Large Message All-to-all Communication Algorithms for Large-scale Dense GPU Systems2021
- EFLOPS: Algorithm and System Co-Design for a High Performance Distributed Training Platform2020
- The Tofu Interconnect D2018
- Deep Residual Learning for Image Recognition2016
- All-to-all personalized communication in multidimensional torus and mesh networksIEEE Transactions on Parallel and Distributed Systems, 2001
- Moore's law: past, present and futureIEEE Spectrum, 1997
- Optimal Algorithms for All-to-All Personalized Communication on Rings and Two Dimensional ToriJournal of Parallel and Distributed Computing, 1997
- A Study of Non-Blocking Switching NetworksBell System Technical Journal, 1953