Quanlu Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Quanlu Zhang has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Fan Yang
Microsoft Research, Beijing, China
2 shared publications - Lidong Zhou
Microsoft Research
2 shared publications - Yuqing Yang
Microsoft Research, Shanghai, China
2 shared publications - Zhenhua Han
Unaffiliated
2 shared publications - Zhenhua Li
Tsinghua University, Beijing, China
2 shared publications - Zhi Yang
Peking University, Beijing, China
2 shared publications
Latest Publications
- Open Access
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 728-743
STAlloc: Enhancing Memory Efficiency in Large-Scale Model Training with Spatio-Temporal Planning
- 26 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 728-743
Open AccessSTAlloc: Enhancing Memory Efficiency in Large-Scale Model Training with Spatio-Temporal Planning
- Open Access
- 23 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 331-347
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
- 23 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 331-347
Open AccessPIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
- Open Access
- 8 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 883-898
SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters
Deep learning training on cloud platforms usually follows the tradition of the separation of storage and computing. The training executes on a compute cluster equipped with GPUs/TPUs while reading data from a separate cluster hosting the storage service. To alleviate the potential bottleneck, a training cluster usually leverages its local storage as a cache to reduce the remote IO from the storage cluster. However, existing deep learning schedulers do not manage storage resources thus fail to consider the diverse caching effects across different training jobs. This could degrade scheduling quality significantly. To address this issue, we present SiloD, a scheduling framework that co-designs the cluster scheduler and the cache subsystems for deep learning training. SiloD treats cache and remote IO as first-class resources and can integrate different state-of-the-art deep learning scheduling policies in a unified scheduling framework. To achieve this, SiloD develops an enhanced job performance estimator to help different schedulers to jointly consider the impact of storage and compute resource allocation while preserving their respective scheduling objectives. The SiloD-enhanced performance estimator leverages the unique data access pattern of deep learning training to develop a closed-form analytic model that captures the diverse cache / remote IO requirements from different training jobs. Evaluations show that SiloD improves the average job completion time, cluster utilization, and fairness by up to 7.4x, 2.57x, and 1.89x, respectively, compared to different combinations of cache systems and cluster schedulers where they operate independently.
- 8 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 883-898
Open AccessSiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters
Deep learning training on cloud platforms usually follows the tradition of the separation of storage and computing. The training executes on a compute cluster equipped with GPUs/TPUs while reading data from a separate cluster hosting the storage service. To alleviate the potential bottleneck, a training cluster usually leverages its local storage as a cache to reduce the remote IO from the storage cluster. However, existing deep learning schedulers do not manage storage resources thus fail to consider the diverse caching effects across different training jobs. This could degrade scheduling quality significantly. To address this issue, we present SiloD, a scheduling framework that co-designs the cluster scheduler and the cache subsystems for deep learning training. SiloD treats cache and remote IO as first-class resources and can integrate different state-of-the-art deep learning scheduling policies in a unified scheduling framework. To achieve this, SiloD develops an enhanced job performance estimator to help different schedulers to jointly consider the impact of storage and compute resource allocation while preserving their respective scheduling objectives. The SiloD-enhanced performance estimator leverages the unique data access pattern of deep learning training to develop a closed-form analytic model that captures the diverse cache / remote IO requirements from different training jobs. Evaluations show that SiloD improves the average job completion time, cluster utilization, and fairness by up to 7.4x, 2.57x, and 1.89x, respectively, compared to different combinations of cache systems and cluster schedulers where they operate independently.
- 1 June 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636927,p. 264-275
DeltaCFS: Boosting Delta Sync for Cloud Storage Services by Learning from NFS
Cloud storage services, such as Dropbox, iCloud Drive, Google Drive, and Microsoft OneDrive, have greatly facilitated users' synchronizing files across heterogeneous devices. Among them, Dropbox-like services are particularly beneficial owing to the delta sync functionality that strives towards greater network-level efficiency. However, when delta sync trades computation overhead for network-traffic saving, the tradeoff could be highly unfavorable under some typical workloads. We refer to this problem as the abuse of delta sync. To address this problem, we propose DeltaCFS, a novel file sync framework for cloud storage services by learning from the design of conventional NFS (Network File System). Specifically, we combine delta sync with NFS-like file RPC in an adaptive manner, thus significantly cutting computation overhead on both the client and server sides while preserving the network-level efficiency. DeltaCFS also enables a neat design for guaranteeing causal consistency and fine-grained version control of files. In our FUSE-based prototype system (which is open-source), DeltaCFS outperforms Dropbox by generating up to 11x less data transfer and up to 100x less computation overhead under concerned workloads.
- 1 June 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636927,p. 264-275
DeltaCFS: Boosting Delta Sync for Cloud Storage Services by Learning from NFS
Cloud storage services, such as Dropbox, iCloud Drive, Google Drive, and Microsoft OneDrive, have greatly facilitated users' synchronizing files across heterogeneous devices. Among them, Dropbox-like services are particularly beneficial owing to the delta sync functionality that strives towards greater network-level efficiency. However, when delta sync trades computation overhead for network-traffic saving, the tradeoff could be highly unfavorable under some typical workloads. We refer to this problem as the abuse of delta sync. To address this problem, we propose DeltaCFS, a novel file sync framework for cloud storage services by learning from the design of conventional NFS (Network File System). Specifically, we combine delta sync with NFS-like file RPC in an adaptive manner, thus significantly cutting computation overhead on both the client and server sides while preserving the network-level efficiency. DeltaCFS also enables a neat design for guaranteeing causal consistency and fine-grained version control of files. In our FUSE-based prototype system (which is open-source), DeltaCFS outperforms Dropbox by generating up to 11x less data transfer and up to 100x less computation overhead under concerned workloads.