Reinforcement-Learning-Based Network Slicing and Resource Allocation for Multi-Access Edge Computing Networks
- 13 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 10 (3) , 1132-1145
Abstract
This paper considers the network slicing and resource allocation problem in a multi-access edge computing (MEC) network. A two-level slicing model is introduced for network slicing and the considered problem is formulated as a long-term optimization problem with an objective to maximize a weighted average of the successful processing ratio of users’ computing tasks in each network slice instance by performing network slicing and resource allocation, while satisfying the service requirements of users’ computing tasks. To solve the formulated problem, we decompose the problem into two subproblems: periodic service-level slicing (SLS) and dynamic resource allocation (DRA), and propose a reinforcement-learning based network slicing and resource allocation (RL-S&A) algorithm, which consists of a QMIX-based SLS algorithm and a PPO-based DRA algorithm, to solve the two sub-problems, respectively. To reduce the training time of an optimal policy to perform periodic SLS, an MAML-based initialization algorithm is introduced to obtain a meta-policy to initialize the neural networks used in the QMIX-based SLS algorithm. Simulation results show that the proposed RL-S&A algorithm can achieve better performance than several benchmark algorithms in terms of the successful processing ratio of users’ computing tasks in the network.Keywords
Funding Information
- Open Research Projects of Zhejiang Lab (2021LC0AB02)
- Fundamental Research Funds for the Central Universities (2242022k60001)
- Key Research & Developement Plan of Jiangsu Province (BE2020084-2)
This publication has 24 references indexed in Scilit:
- A DQN-Based Joint Computing Offloading and Resource Allocation Algorithm for MEC Networks2023
- DDPG-Based Joint Resource Management for Latency Minimization in NOMA-MEC NetworksIEEE Communications Letters, 2023
- Efficient and Fair Multi-Resource Allocation in Dynamic Fog Radio Access Network SlicingIEEE Internet of Things Journal, 2022
- Adaptive and Priority-Based Resource Allocation for Efficient Resources Utilization in Mobile-Edge ComputingIEEE Internet of Things Journal, 2021
- Resource Provisioning in Edge Computing for Latency-Sensitive ApplicationsIEEE Internet of Things Journal, 2021
- Cloud-Native Network Slicing Using Software Defined Networking Based Multi-Access Edge Computing: A SurveyIEEE Access, 2021
- MEC Support for Network Slicing: Status and Limitations from a Standardization ViewpointIEEE Communications Standards Magazine, 2020
- GAN-Based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing2019
- SDN/NFV-Empowered Future IoV With Enhanced Communication, Computing, and CachingProceedings of the IEEE, 2019
- Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement LearningIEEE Internet of Things Journal, 2018