Distributed Machine Learning on IAAS Clouds
Authors:
- 1 November 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 58-62
Abstract
Training complex machine learning (ML) models with large datasets requires powerful computing infrastructure, which is costly to acquire and maintain. As a result, ML researchers turn to the cloud for on-demand and elastic resource provisioning capabilities. Two issues have arisen from this trend: 1) if not configured properly, training ML models on the cloud could incur significant cost and time, and 2) many researchers in ML tend to focus more on model and algorithm development, so they may not have enough time or skills to deal with system setup, resource selection and configuration. In this work, we propose and implement FC 2 : a web service for fast, convenient and cost-effective distributed ML model training over public cloud resource. Central to the effectiveness of FC 2 is the ability to recommend an appropriate resource configuration in terms of cost and execution time for a given ML training task. Extensive experiments with real-world deep neural network models and datasets demonstrate the effectiveness of our solution.Keywords
This publication has 9 references indexed in Scilit:
- Towards Distributed Machine Learning in Shared Clusters: A Dynamically-Partitioned Approach2017
- Modeling Scalability of Distributed Machine Learning2017
- Timed Dataflow: Reducing Communication Overhead for Distributed Machine Learning Systems2016
- Deep Learning at Scale and at EaseACM Transactions on Multimedia Computing, Communications, and Applications, 2016
- Ako2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Performance Modeling and Scalability Optimization of Distributed Deep Learning Systems2015
- Scaling Distributed Machine Learning with the Parameter Server2014
- Distributed GraphLabProceedings of the VLDB Endowment, 2012