Deep Reinforcement Learning for Resource Demand Prediction and Virtual Function Network Migration in Digital Twin Network
- 1 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (21) , 19102-19116
Abstract
Internet of Things (IoT) enables intelligent services varying with the complex and realtime environment to achieve network benefits, where Network Function Virtualization (NFV) can dynamically provide Virtualized Network Functions (VNFs) for IoT devices. In NFV-enabled IoT architecture, a service function chain (SFC) consists of an ordered set of virtual network functions (VNFs). However, the energy consumption of the VNF migration and SFC reconfiguration is one major issue owing to the dynamic characteristic of IoT network. In this paper, we propose a new paradigm digital twin (DT) to create the virtual twin of physical objects in IoT network, then, we formalize the problem as a mathematical model, which aims to minimize the energy consumption. To this end, we prove this problem is NP-hard and propose an algorithm Bidirectional Gated Recurrent Unit (Bi-GRU) based on federated learning to predict the resource requirement. Further more, according to the prediction result, which utilizing the deep reinforcement learning (DRL) algorithm for decision making of the VNF migration. Simulation results show that our proposed method can effectively reduce the number of VNFs to be migrated and economize the energy consumption of the digital twin IoT network.Keywords
Funding Information
- National Natural Science Foundation of China (62071078)
- Sichuan Science and Technology Program (2021YFQ0053)
This publication has 37 references indexed in Scilit:
- Virtual Network Function Migration Based on Dynamic Resource Requirements PredictionIEEE Access, 2019
- Energy-Efficient Dynamic Virtual Machine Management in Data CentersIEEE/ACM Transactions on Networking, 2019
- A Survey on Emerging SDN and NFV Security Mechanisms for IoT SystemsIEEE Communications Surveys & Tutorials, 2018
- A Novel Multichannel Internet of Things Based on Dynamic Spectrum Sharing in 5G CommunicationIEEE Internet of Things Journal, 2018
- Adaptive Transmission Optimization in SDN-Based Industrial Internet of Things With Edge ComputingIEEE Internet of Things Journal, 2018
- NFV and SDN—Key Technology Enablers for 5G NetworksIEEE Journal on Selected Areas in Communications, 2017
- Industrial Internet: A Survey on the Enabling Technologies, Applications, and ChallengesIEEE Communications Surveys & Tutorials, 2017
- CogNitive 5G networks: Comprehensive operator use cases with machine learning for management operations2017
- Forecasting and anticipating SLO breaches in programmable networks2017
- Data Center Energy Consumption Modeling: A SurveyIEEE Communications Surveys & Tutorials, 2015