MIRAS: Model-based Reinforcement Learning for Microservice Resource Allocation over Scientific Workflows
Authors:
- 1 July 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 122-132
Abstract
Microservice, an architectural design that decomposes applications into loosely coupled services, is adopted in modern software design, including cloud-based scientific workflow processing. The microservice design makes scientific workflow systems more modular, more flexible, and easier to develop. However, cloud deployment of microservice workflow execution systems doesn't come for free, and proper resource management decisions have to be made in order to achieve certain performance objective (e.g., response time) within constraint operation cost. Nevertheless, effective online resource allocation decisions are hard to achieve due to dynamic workloads and the complicated interactions of microservices in each workflow. In this paper, we propose an adaptive resource allocation approach for microservice workflow system based on recent advances in reinforcement learning. Our approach (1) assumes little prior knowledge of the microservice workflow system and does not require any elaborately designed model or crafted representative simulator of the underlying system, and (2) avoids high sample complexity which is a common drawback of model-free reinforcement learning when applied to real-world scenarios. We show that our proposed approach automatically achieves effective policy for resource allocation with limited number of time-consuming interactions with the microservice workflow system. We perform extensive evaluations to validate the effectiveness of our approach and demonstrate that it outperforms existing resource allocation approaches with read-world emulated workflows.Keywords
This publication has 20 references indexed in Scilit:
- DRS: Dynamic Resource Scheduling for Real-Time Analytics over Fast Streams2015
- A Survey of Data-Intensive Scientific Workflow ManagementJournal of Grid Computing, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Multi-resource packing for cluster schedulersACM SIGCOMM Computer Communication Review, 2014
- Characterizing and profiling scientific workflowsFuture Generation Computer Systems, 2013
- Learning to Control a Low-Cost Manipulator using Data-Efficient Reinforcement Learning2011
- Workflows and e-Science: An overview of workflow system features and capabilitiesFuture Generation Computer Systems, 2009
- Workflow Scheduling Algorithms for Grid Computing2008
- Scheduling Scientific Workflow Applications with Deadline and Budget Constraints Using Genetic AlgorithmsScientific Programming, 2006
- Scheduling of scientific workflows in the ASKALON grid environmentACM SIGMOD Record, 2005