5G Service Function Chain Provisioning: A Deep Reinforcement Learning-Based Framework
- 5 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 21 (6) , 6614-6629
Abstract
We study the dynamic joint service function chain (SFC) embedding problem in a network function virtualization (NFV)-enabled edge cloud network. Our design goal is to optimize the network throughput by maximizing the average number of SFCs successfully embedded into the network, i.e., the Grade of Service (GoS), while guaranteeing their individual stringent end-to-end delay and resource constraints over a time horizon. To this end, we proposed a deep reinforcement learning (DRL)-based framework for jointly performing VNF embedding and routing tasks for the arrival SFCs in the considered NFV-enabled network. We implemented two versions of the proposed framework, one with the Deep Q-learning (DQL) method and one with the Advantage Actor-Critic (A2C) as the core algorithms, respectively. Moreover, for training these DRL algorithms and demonstrating the performance of the proposed framework, we implement a network environment based on the real-world network topology and a service request generator for generating SFCs traffic. Numerical results show that the DQL and A2C versions of the proposed framework achieve over 95% of the average GoS and over 95% of the network throughput ratio compared to the upper bound. This performance level is comparable to that of the near-optimal optimization-based approach while having ten times shorter execution times.Keywords
Funding Information
- Mitacs
- Ciena
This publication has 36 references indexed in Scilit:
- A survey on the placement of virtual network functionsJournal of Network and Computer Applications, 2022
- Traffic Engineering Based on Reinforcement Learning for Service Function Chaining With Delay GuaranteeIEEE Access, 2021
- A comprehensive survey of service function chain provisioning approaches in SDN and NFV architectureComputer Science Review, 2020
- Machine learning-driven service function chain placement and scaling in MEC-enabled 5G networksComputer Networks, 2020
- Multi-agent deep learning for simultaneous optimization for time and energy in distributed routing systemFuture Generation Computer Systems, 2019
- VNF placement for service chaining in a distributed cloud environment with multiple stakeholdersComputer Communications, 2019
- A novel reinforcement learning algorithm for virtual network embeddingNeurocomputing, 2018
- VNF-FG design and VNF placement for 5G mobile networksScience China Information Sciences, 2017
- Human-level control through deep reinforcement learningNature, 2015
- Accelerated label setting algorithms for the elementary resource constrained shortest path problemOperations Research Letters, 2006