Performance Optimization Across the Edge-Cloud Continuum: A Multi-agent Rollout Approach for Cloud-Native Application Workload Placement
Open Access
- 13 March 2024
- journal article
- research article
- Published by Springer Nature in SN Computer Science
- Vol. 5 (3) , 1-13
Abstract
The advancements in virtualization technologies and distributed computing infrastructures have sparked the development of cloud-native applications. This is grounded in the breakdown of a monolithic application into smaller, loosely connected components, often referred to as microservices, enabling enhancements in the application’s performance, flexibility, and resilience, along with better resource utilization. When optimizing the performance of cloud-native applications, specific demands arise in terms of application latency and communication delays between microservices that are not taken into consideration by generic orchestration algorithms. In this work, we propose mechanisms for automating the allocation of computing resources to optimize the service delivery of cloud-native applications over the edge-cloud continuum. We initially introduce the problem’s Mixed Integer Linear Programming (MILP) formulation. Given the potentially overwhelming execution time for real-sized problems, we propose a greedy algorithm, which allocates resources sequentially in a best-fit manner. To further improve the performance, we introduce a multi-agent rollout mechanism that evaluates the immediate effect of decisions but also leverages the underlying greedy heuristic to simulate the decisions anticipated from other agents, encapsulating this in a Reinforcement Learning framework. This approach allows us to effectively manage the performance–execution time trade-off and enhance performance by controlling the exploration of the Rollout mechanism. This flexibility ensures that the system remains adaptive to varied scenarios, making the most of the available computational resources while still ensuring high-quality decisions.Keywords
This publication has 24 references indexed in Scilit:
- Resource Allocation for Distributed Machine Learning at the Edge-Cloud Continuum2022
- IoT services in healthcare industry with fog/edge and cloud computing2021
- Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSAIEEE Access, 2020
- Quality of Experience (QoE)-aware placement of applications in Fog computing environmentsJournal of Parallel and Distributed Computing, 2019
- Convergence of deep machine learning and parallel computing environment for bio‐engineering applicationsConcurrency and Computation: Practice and Experience, 2019
- Topology-Aware Resource Allocation for IoT Services in CloudsIEEE Access, 2018
- Resource Allocation Mechanism for a Fog-Cloud Infrastructure2018
- Cost-aware DAG scheduling algorithms for minimizing execution cost on cloud resourcesThe Journal of Supercomputing, 2016
- Evaluating the monolithic and the microservice architecture pattern to deploy web applications in the cloud2015
- CA-DAG: Communication-Aware Directed Acyclic Graphs for Modeling Cloud Computing Applications2013