Byunggu Kang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Interests
Byunggu Kang has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Donggyu Yang
Seoul National University, Seoul, Republic of Korea
2 shared publications - Kyunghan Lee
Seoul National University, Seoul, Republic of Korea
2 shared publications - Daewook Hwang
Seoul National University, Seoul, Republic of Korea
1 shared publication - Gibum Park
Seoul National University, Seoul, Republic of Korea
1 shared publication - Jaeyoon Hwang
Seoul National University, Seoul, Republic of Korea
1 shared publication - Sanghyun Han
Seoul National University, Seoul, Republic of Korea
1 shared publication
Latest Publications
- Open Access
- 1 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Networking
- Vol. 4 (CoNEXT2) , 1-23
PRC: Process-centric Rate Control for Transient Stragglers in Hybrid-Parallel Training
Stragglers remain an open challenge in large model training, forcing other GPUs to wait at synchronization barriers. While severe, persistent stragglers have been actively studied, their transient counterparts are often overlooked due to their short-lived nature. We reveal that the interplay between the transient straggler effects and network contention drastically amplifies the relative delays across workers, significantly slowing down training iterations. To address this, an intuitive approach is to prioritize bandwidth for the straggler, allowing it to catch up to the front-runners. However, while the transport layer is well-positioned to accommodate such responsive bandwidth control, conventional designs lack visibility into process-level progress. To bridge this gap, we propose PRC (Process-centric Rate Control), a new sending-rate control designed to mitigate the transient straggler effects. PRC adjusts NIC sending rates by inferring local GPU process-level information, enabling transient straggler processes to utilize more bandwidth on time. Extensive experiments on both a real-world cluster and large-scale simulations confirm that PRC effectively accelerates transient stragglers, achieving a training speedup of up to 28% compared to using state-of-the-art datacenter congestion control schemes.
- 1 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Networking
- Vol. 4 (CoNEXT2) , 1-23
Open AccessPRC: Process-centric Rate Control for Transient Stragglers in Hybrid-Parallel Training
Stragglers remain an open challenge in large model training, forcing other GPUs to wait at synchronization barriers. While severe, persistent stragglers have been actively studied, their transient counterparts are often overlooked due to their short-lived nature. We reveal that the interplay between the transient straggler effects and network contention drastically amplifies the relative delays across workers, significantly slowing down training iterations. To address this, an intuitive approach is to prioritize bandwidth for the straggler, allowing it to catch up to the front-runners. However, while the transport layer is well-positioned to accommodate such responsive bandwidth control, conventional designs lack visibility into process-level progress. To bridge this gap, we propose PRC (Process-centric Rate Control), a new sending-rate control designed to mitigate the transient straggler effects. PRC adjusts NIC sending rates by inferring local GPU process-level information, enabling transient straggler processes to utilize more bandwidth on time. Extensive experiments on both a real-world cluster and large-scale simulations confirm that PRC effectively accelerates transient stragglers, achieving a training speedup of up to 28% compared to using state-of-the-art datacenter congestion control schemes.
- Open Access
- 23 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 374-387
Empilo: Realizing Immersive Mobile 3D Video Conferencing through Parameterized Communication
- 23 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 374-387
Open AccessEmpilo: Realizing Immersive Mobile 3D Video Conferencing through Parameterized Communication