Reinforcement Learning Framework for Server Placement and Workload Allocation in Multi-Access Edge Computing
Preprint
Abstract
Cloud computing is a reliable solution to provide distributed computation power. However, real-time response is still challenging regarding the enormous amount of data generated by the IoT devices in 5G and 6G networks. Thus, multi-access edge computing (MEC), which consists of distributing the edge servers in the proximity of end-users to have low latency besides the higher processing power, is increasingly becoming a vital factor for the success of modern applications. This paper addresses the problem of minimizing both, the network delay, which is the main objective of MEC, and the number of edge servers to provide a MEC design with minimum cost. This MEC design consists of edge servers placement and base stations allocation, which makes it a joint combinatorial optimization problem (COP). Recently, reinforcement learning (RL) has shown promising results for COPs. However, modeling real-world problems using RL when the state and action spaces are large still needs investigation. We propose a novel RL framework with an efficient representation and modeling of the state space, action space and the penalty function in the design of the underlying Markov Decision Process (MDP) for solving our problem.Keywords
All Related Versions
- Version 1, 2022-02-21, ArXiv
- Published version: IEEE Internet of Things Journal, 10 (2), 1376.
This publication has 17 references indexed in Scilit:
- Reinforcement learning for combinatorial optimization: A surveyComputers & Operations Research, 2021
- Deep reinforcement learning based mobile edge computing for intelligent Internet of ThingsPhysical Communication, 2020
- Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSAIEEE Access, 2020
- A New Cloudlet Placement Method Based on Affinity Propagation for Cyber-Physical-Social Systems in Wireless Metropolitan Area NetworksIEEE Access, 2020
- Edge server placement in mobile edge computingJournal of Parallel and Distributed Computing, 2019
- QoS prediction for service recommendations in mobile edge computingJournal of Parallel and Distributed Computing, 2019
- User allocation‐aware edge cloud placement in mobile edge computingSoftware: Practice and Experience, 2019
- Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computingDigital Communications and Networks, 2019
- Internet of Things: A Survey on Enabling Technologies, Protocols, and ApplicationsIEEE Communications Surveys & Tutorials, 2015
- Towards an Elastic Application Model for Augmenting the Computing Capabilities of Mobile Devices with Cloud ComputingMobile Networks and Applications, 2011