DL2: A Deep Learning-Driven Scheduler for Deep Learning Clusters
Top Cited Papers
- 19 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 32 (8) , 1947-1960
Abstract
Efficient resource scheduling is essential for maximal utilization of expensive deep learning (DL) clusters. Existing cluster schedulers either are agnostic to machine learning (ML) workload characteristics, or use scheduling heuristics based on operators' understanding of particular ML framework and workload, which are less efficient or not general enough. In this article, we show that DL techniques can be adopted to design a generic and efficient scheduler. Specifically, we propose DL2, a DL-driven scheduler for DL clusters, targeting global training job expedition by dynamically resizing resources allocated to jobs. DL2 advocates a joint supervised learning and reinforcement learning approach: a neural network is warmed up via offline supervised learning based on job traces produced by the existing cluster scheduler; then the neural network is plugged into the live DL cluster, fine-tuned by reinforcement learning carried out throughout the training progress of the DL jobs, and used for deciding job resource allocation in an online fashion. We implement DL2 on Kubernetes and enable dynamic resource scaling in DL jobs on MXNet. Extensive evaluation shows that DL2 outperforms fairness scheduler (i.e., DRF) by 44.1 percent and expert heuristic scheduler (i.e., Optimus) by 17.5 percent in terms of average job completion time.Keywords
All Related Versions
Funding Information
- Alibaba Innovative Research
- Hong Kong RGC (HKU 17204619, 17208920)
This publication has 27 references indexed in Scilit:
- Resource Management with Deep Reinforcement Learning2016
- Petuum: A New Platform for Distributed Machine Learning on Big DataIEEE Transactions on Big Data, 2015
- Large-scale cluster management at Google with Borg2015
- Human-level control through deep reinforcement learningNature, 2015
- A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval2014
- Apache Hadoop YARN2013
- Speech recognition with deep recurrent neural networks2013
- Genetic Algorithm Based Scheduler for Computational Grids2005
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Simple statistical gradient-following algorithms for connectionist reinforcement learningMachine Learning, 1992