Reclaimer: A Reinforcement Learning Approach to Dynamic Resource Allocation for Cloud Microservices
Preprint
Abstract
Many cloud applications are migrated from the monolithic model to a microservices framework in which hundreds of loosely-coupled microservices run concurrently, with significant benefits in terms of scalability, rapid development, modularity, and isolation. However, dependencies among microservices with uneven execution time may result in longer queues, idle resources, or Quality-of-Service (QoS) violations. In this paper we introduce Reclaimer, a deep reinforcement learning model that adapts to runtime changes in the number and behavior of microservices in order to minimize CPU core allocation while meeting QoS requirements. When evaluated with two benchmark microservice-based applications, Reclaimer reduces the mean CPU core allocation by 38.4% to 74.4% relative to the industry-standard scaling solution, and by 27.5% to 58.1% relative to a current state-of-the art method.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Online Microservice Orchestration for IoT via Multiobjective Deep Reinforcement LearningIEEE Internet of Things Journal, 2022
- AlphaR: Learning-Powered Resource Management for Irregular, Dynamic Microservice Graph2021
- QoS-Aware and Resource Efficient Microservice Deployment in Cloud-Edge Continuum2021
- DeepRecSys: A System for Optimizing End-To-End At-Scale Neural Recommendation Inference2020
- CLITE: Efficient and QoS-Aware Co-Location of Multiple Latency-Critical Jobs for Warehouse Scale Computers2020
- MIRAS: Model-based Reinforcement Learning for Microservice Resource Allocation over Scientific Workflows2019
- HyScale: Hybrid and Network Scaling of Dockerized Microservices in Cloud Data Centres2019
- Ant Colony Algorithm for Multi-Objective Optimization of Container-Based Microservice Scheduling in CloudIEEE Access, 2019
- Experience-driven Networking: A Deep Reinforcement Learning based Approach2018
- Human-level control through deep reinforcement learningNature, 2015