Deep Reinforcement Learning for AoI Aware VNF Placement in Multiple Source Systems
Authors:
- 4 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2873-2878
Abstract
Age of Information (AoI) is a newly emergent performance metric to quantify the freshness of data from destinations' perspectives. In this paper, we investigate and analyze AoI in the context of a multiple source updating system. In such a system, multiple loT devices continuously monitors physical environment and sends data to a remote destination for status updates through a Network Function Virtualization (NFV)-enabled network. Considering that the Virtual Network Function (VNF) placement can unnecessarily influence the AoI of the updates, we study the VNF placement problem in such a system. The problem is hence formulated as a mathematical optimization problem aiming to minimize the long-term average AoI of all updates received at the destination. To solve this prob-lem, we propose a Deep Reinforcement Learning (DRL)-based VNF placement approach called VNF-AoI, where a learning agent or decision-maker interacts with a system environment and consequently provides an optimal VNF placement policy according to the experience it has learned. Finally, we conduct extensive simulations to validate the effectiveness of our proposed approach. Numerical results clearly demonstrate that our VNF-AoI surpasses other two baseline algorithms by averagely 13.8 % higher acceptance ratio and 20.3 % lower average AoI at the destination.Keywords
Funding Information
- JSPS KAKENHI (JP19K20250,JP20H04174,JP22K11989)
This publication has 16 references indexed in Scilit:
- Energy-Saving and Resource-Efficient Algorithm for Virtual Network Function Placement With Network ScalingIEEE Transactions on Green Communications and Networking, 2020
- Cost-Efficient VNF Placement and Scheduling in Public Cloud NetworksIEEE Transactions on Communications, 2020
- Adaptive service function chaining mappings in 5G using deep Q-learningComputer Communications, 2020
- Virtual Network Function Placement Optimization With Deep Reinforcement LearningIEEE Journal on Selected Areas in Communications, 2019
- On Minimizing the Maximum Age-of-Information For Wireless Erasure Channels2019
- Scheduling Policies for Minimizing Age of Information in Broadcast Wireless NetworksIEEE/ACM Transactions on Networking, 2018
- Cost Efficient VNF Placement with Optimization Problem for Security-Aware Virtual Networks2018
- DeepNFV: A Lightweight Framework for Intelligent Edge Network Functions VirtualizationIEEE Network, 2018
- A Green VNF-FG Embedding Algorithm2018
- The Internet Topology ZooIEEE Journal on Selected Areas in Communications, 2011