Flexible Resource Block Allocation to Multiple Slices for Radio Access Network Slicing Using Deep Reinforcement Learning
Open Access
- 6 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 68183-68198
Abstract
In the fifth-generation of mobile communications, network slicing is used to provide an optimal network for various services as a slice. In this paper, we propose a radio access network (RAN) slicing method that flexibly allocates RAN resources using deep reinforcement learning (DRL). In RANs, the number of slices controlled by a base station fluctuates in terms of user ingress and egress from the base station coverage area and service switching on the respective sets of user equipment. Therefore, when resource allocation depends on the number of slices, resources cannot be allocated when the number of slices changes. We consider a method that makes optimal-resource allocation independent of the number of slices. Resource allocation is optimized using DRL, which learns the best action for a state through trial and error. To achieve independence from the number of slices, we show a design for a model that manages resources on a one-slice-by-one-agent basis using Ape-X, which is a DRL method. In Ape-X, because agents can be employed in parallel, models that learn various environments can be generated through trial and error of multiple environments. In addition, we design a model that satisfies the slicing requirements without over-allocating resources. Based on this design, it is possible to optimally allocate resources independently of the number of slices by changing the number of agents. In the evaluation, we test multiple scenarios and show that the mean satisfaction of the slice requirements is approximately 97%.Keywords
Funding Information
- Japan Society for the Promotion of Science (17H01730)
This publication has 22 references indexed in Scilit:
- On 5G Radio Access Network Slicing: Radio Interface Protocol Features and ConfigurationIEEE Communications Magazine, 2018
- Deep Reinforcement Learning: A Brief SurveyIEEE Signal Processing Magazine, 2017
- Network Slicing Based 5G and Future Mobile Networks: Mobility, Resource Management, and ChallengesIEEE Communications Magazine, 2017
- Network Slices toward 5G Communications: Slicing the LTE NetworkIEEE Communications Magazine, 2017
- Network Slicing in 5G: Survey and ChallengesIEEE Communications Magazine, 2017
- Intelligent 5G: When Cellular Networks Meet Artificial IntelligenceIEEE Wireless Communications, 2017
- 5G service requirements and operational use cases: Analysis and METIS II vision2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Challenges in 5G: how to empower SON with big data for enabling 5GIEEE Network, 2014
- Q-learningMachine Learning, 1992