Actor-Critic-Based Learning for Zero-touch Joint Resource and Energy Control in Network Slicing
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
To harness the full potential of beyond 5G (B5G) communication systems, zero-touch network slicing (NS) is viewed as a promising fully-automated management and orchestration (MANO) system. This paper proposes a novel knowledge plane (KP)-based MANO framework that accommodates and exploits recent NS technologies and is termed KB5G. Specifically, we deliberate on algorithmic innovation and artificial intelligence (AI) in KB5G. We invoke a continuous model-free deep reinforcement learning (DRL) method to minimize energy consumption and virtual network function (VNF) instantiation cost. We present a novel Actor-Critic-based NS approach to stabilize learning called, twin-delayed double-Q soft Actor-Critic (TDSAC) method. The TDSAC enables central unit (CU) to learn continuously to accumulate the knowledge learned in the past to minimize future NS costs. Finally, we present numerical results to showcase the gain of the adopted approach and verify the performance in terms of energy consumption, CPU utilization, and time efficiency.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- vrAIn2019
- Deep Deterministic Policy Gradient Based Dynamic Power Control for Self-Powered Ultra-Dense Networks2018
- Machine Learning in Control Systems: An Overview of the State of the Art2018
- Knowledge-Defined NetworkingACM SIGCOMM Computer Communication Review, 2017
- On evaluating different trends for virtualized and SDN-ready mobile network2017
- System Cost Minimization in Cloud RAN With Limited Fronthaul CapacityIEEE Transactions on Wireless Communications, 2017
- How Much Computing Capability Is Enough to Run a Cloud Radio Access Network?IEEE Communications Letters, 2016
- Energy-Efficient Resource Allocation Optimization for Multimedia Heterogeneous Cloud Radio Access NetworksIEEE Transactions on Multimedia, 2016
- Optimal Multiuser Transmit Beamforming: A Difficult Problem with a Simple Solution Structure [Lecture Notes]IEEE Signal Processing Magazine, 2014
- Group Sparse Beamforming for Green Cloud-RANIEEE Transactions on Wireless Communications, 2014