Service Function Chaining in Industrial Internet of Things With Edge Intelligence: A Natural Actor-Critic Approach
- 24 May 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 19 (1) , 491-502
Abstract
Owing to network function virtualization (NFV), each industrial application is constructed as a service function chain (SFC), concatenating the ordered service functions, to offer applications more flexibly in industrial Internet of Things (IIoT). When it comes to the emerging edge intelligence, the integration of NFV with edge in IIoT would enable more close-proximity services, yet also posing new challenges owing to more complicated environment. Although some efforts have been made to service function chaining in IIoT, the radio resource dynamics are not fully perceived. In this article, we investigate the radio-aware SFC deployment in the edge-enabled IIoT. First, a radio-aware deployment formulation is exhibited, steering the flow traversing both wireless and wired links. Next, Markov decision process is exhibited to track dynamics in both IIoT and radio resources. Afterwards, the natural gradient-based actor-critic SFC paradigm is introduced to adapt to network variation, by incorporating the curvature of parameter space into gradient information. To resolve the high-dimensionality in action space, we then recur to the norm penalty approach, reducing the space size by two orders of magnitude. Finally, numerical experiments are executed to uncover superiority of presented method, disclosing that the latency performance benefits from both the SFC routing between IIoT servers and elaborated wireless resource orchestration.Keywords
Funding Information
- National Key Research and Development Program of China (2018YFB1703003)
- National Natural Science Foundation of China (61801379)
- Foundation of the State Key Laboratory of Integrated Services Networks of Xidian University (ISN21-08)
- Project of Xi'an Science and Technology Planning Foundation (2020KJRC0093)
- Water conservancy science and technology project of Shaanxi Province (2020slkj-17)
This publication has 34 references indexed in Scilit:
- Online Resource Allocation, Content Placement and Request Routing for Cost-Efficient Edge Caching in Cloud Radio Access NetworksIEEE Journal on Selected Areas in Communications, 2018
- Formally verified latency-aware VNF placement in industrial Internet of things2018
- CPVNF: Cost-Efficient Proactive VNF Placement and Chaining for Value-Added Services in Content Delivery NetworksIEEE Transactions on Network and Service Management, 2018
- Network Slicing for Service-Oriented Networks Under Resource ConstraintsIEEE Journal on Selected Areas in Communications, 2017
- QoS-Aware and Reliable Traffic Steering for Service Function Chaining in Mobile NetworksIEEE Journal on Selected Areas in Communications, 2017
- Deep-Reinforcement-Learning-Based Optimization for Cache-Enabled Opportunistic Interference Alignment Wireless NetworksIEEE Transactions on Vehicular Technology, 2017
- A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy GradientsIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2012
- Natural actor–critic algorithmsAutomatica, 2009
- Natural Actor-CriticNeurocomputing, 2008
- The structure and function of networksComputer Physics Communications, 2002