Zhenghang Ren
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhenghang Ren has a total of 30 co-authors. Here are the top co-authors by number of shared publications:
- Kai Chen
Hong Kong University of Science and Technology, Hong Kong, Hong Kong
6 shared publications - Wenxue Li
Hong Kong University of Science and Technology, Hong Kong, Hong Kong
3 shared publications - Xinchen Wan
Hong Kong University of Science and Technology, Hong Kong, Hong Kong
3 shared publications - Xudong Liao
Hong Kong University of Science and Technology, Hong Kong, Hong Kong
3 shared publications - Han Tian
University of Science and Technology of China, Hefei, China
2 shared publications - Junxue Zhang
University of Science and Technology of China, Hefei, China
2 shared publications
Latest Publications
- Open Access
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 1232-1234
Coflow Scheduling for LLM Training
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 1232-1234
Open AccessCoflow Scheduling for LLM Training
- Open Access
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 85-98
Revisiting RDMA Reliability for Lossy Fabrics
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 85-98
Open AccessRevisiting RDMA Reliability for Lossy Fabrics
- Open Access
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 554-574
MixNet: A Runtime Reconfigurable Optical-Electrical Fabric for Distributed Mixture-of-Experts Training
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 554-574
Open AccessMixNet: A Runtime Reconfigurable Optical-Electrical Fabric for Distributed Mixture-of-Experts Training
- Open Access
- 6 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 59-65
Congestion Control for AI Workloads with Message-Level Signaling
- 6 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 59-65
Open AccessCongestion Control for AI Workloads with Message-Level Signaling
- Open Access
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 295-310
Design and Operation of Shared Machine Learning Clusters on Campus
The rapid advancement of large machine learning (ML) models has driven universities worldwide to invest heavily in GPU clusters. Effectively sharing these resources among multiple users is essential for maximizing both utilization and accessibility. However, managing shared GPU clusters presents significant challenges, ranging from system configuration to fair resource allocation among users. This paper introduces SING, a full-stack solution tailored to simplify shared GPU cluster management. Aimed at addressing the pressing need for efficient resource sharing with limited staffing, SING enhances operational efficiency by reducing maintenance costs and optimizing resource utilization. We provide a comprehensive overview of its four extensible architectural layers, explore the features of each layer, and share insights from real-world deployment, including usage patterns and incident management strategies. As part of our commitment to advancing shared ML cluster management, we open-source SING's resources to support the development and operation of similar systems.
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 295-310
Open AccessDesign and Operation of Shared Machine Learning Clusters on Campus
The rapid advancement of large machine learning (ML) models has driven universities worldwide to invest heavily in GPU clusters. Effectively sharing these resources among multiple users is essential for maximizing both utilization and accessibility. However, managing shared GPU clusters presents significant challenges, ranging from system configuration to fair resource allocation among users. This paper introduces SING, a full-stack solution tailored to simplify shared GPU cluster management. Aimed at addressing the pressing need for efficient resource sharing with limited staffing, SING enhances operational efficiency by reducing maintenance costs and optimizing resource utilization. We provide a comprehensive overview of its four extensible architectural layers, explore the features of each layer, and share insights from real-world deployment, including usage patterns and incident management strategies. As part of our commitment to advancing shared ML cluster management, we open-source SING's resources to support the development and operation of similar systems.
- Open Access
- 28 June 2022
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 13 (4) , 1-20
Improving Availability of Vertical Federated Learning: Relaxing Inference on Non-overlapping Data
Vertical Federated Learning (VFL) enables multiple parties to collaboratively train a machine learning model over vertically distributed datasets without data privacy leakage. However, there is a limitation of the current VFL solutions: current VFL models fail to conduct inference on non-overlapping samples during inference. This limitation seriously damages the VFL model’s availability because, in practice, overlapping samples may only take up a small portion of the whole data at each party which means a large part of inference tasks will fail. In this article, we propose a novel VFL framework which enables federated inference on non-overlapping data. Our framework regards the distributed features as privileged information which is available in the training period but disappears during inference. We distill the knowledge of such privileged features and transfer them to the parties’ local model which only processes local features. Furthermore, we adopt Oblivious Transfer (OT) to preserve data ID privacy during training and inference. Empirically, we evaluate the model on the real-world dataset collected from Criteo and Taobao. Besides, we also provide a security analysis of the proposed framework.
- 28 June 2022
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 13 (4) , 1-20
Open AccessImproving Availability of Vertical Federated Learning: Relaxing Inference on Non-overlapping Data
Vertical Federated Learning (VFL) enables multiple parties to collaboratively train a machine learning model over vertically distributed datasets without data privacy leakage. However, there is a limitation of the current VFL solutions: current VFL models fail to conduct inference on non-overlapping samples during inference. This limitation seriously damages the VFL model’s availability because, in practice, overlapping samples may only take up a small portion of the whole data at each party which means a large part of inference tasks will fail. In this article, we propose a novel VFL framework which enables federated inference on non-overlapping data. Our framework regards the distributed features as privileged information which is available in the training period but disappears during inference. We distill the knowledge of such privileged features and transfer them to the parties’ local model which only processes local features. Furthermore, we adopt Oblivious Transfer (OT) to preserve data ID privacy during training and inference. Empirically, we evaluate the model on the real-world dataset collected from Criteo and Taobao. Besides, we also provide a security analysis of the proposed framework.