Deep Reinforcement Learning for Intelligent Service Provisioning in Software-Defined Industrial Fog Networks
- 13 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (18) , 16953-16961
Abstract
Fog computing has become a promising technology to improve the performance of low-powered Industrial Internet of Things (IIoT) devices by providing flexible and convenient computing services at the edge of the network with minimum delay. However, due to the ever-increasing traffic load in the network, the traditional service provisioning strategies can pose high complexity as well as network congestion, resulting in high energy consumption. Owing to this issue, in this paper, we propose a deep reinforcement learning (DRL) based service provisioning strategy in a software-defined industrial fog network to minimize the energy consumption of the network. The service provisioning strategy is performed in the network data plane, whereas the DRL is deployed in the control plane to enhance network efficiency. The service provisioning problem is formulated as the Markov decision process (MDP) and further solved by adopting the concept of deep Q network (DQN). Further, we propose a task migration policy to ensure the high availability of computing devices while meeting a single point of failure (SPOF) issue. Finally, to show the effectiveness of the proposed method, it is compared with the traditional baseline algorithms over various performance metrics.Keywords
This publication has 20 references indexed in Scilit:
- Joint Resource Allocation for Device-to-Device Communication Assisted Fog ComputingIEEE Transactions on Mobile Computing, 2019
- DPTO: A Deadline and Priority-Aware Task Offloading in Fog Computing Framework Leveraging Multilevel Feedback QueueingIEEE Internet of Things Journal, 2019
- Detour: Dynamic Task Offloading in Software-Defined Fog for IoT ApplicationsIEEE Journal on Selected Areas in Communications, 2019
- Resource Allocation and Task Offloading for Heterogeneous Real-Time Tasks With Uncertain Duration Time in a Fog Queueing SystemIEEE Access, 2019
- Centralized and Distributed Architectures for Energy and Delay Efficient Fog Network-Based Edge Computing ServicesIEEE Transactions on Green Communications and Networking, 2018
- Distributed Energy Management for Multiuser Mobile-Edge Computing Systems With Energy Harvesting Devices and QoS ConstraintsIEEE Internet of Things Journal, 2018
- IoT survey: An SDN and fog computing perspectiveComputer Networks, 2018
- Deep Reinforcement Learning-Based Mode Selection and Resource Management for Green Fog Radio Access NetworksIEEE Internet of Things Journal, 2018
- Software-Defined Networking for Internet of Things: A SurveyIEEE Internet of Things Journal, 2017
- Software-Defined Wireless Networking Opportunities and Challenges for Internet-of-Things: A ReviewIEEE Internet of Things Journal, 2015