Enabling Robust and Generalized DRL-Driven Routing Optimization Via Exploration of Graph Neural Networks
- 20 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 11 (6) , 4281-4298
Abstract
Packet routing in modern communication networks faces increasing challenges due to evolving network dynamics and stringent quality-of-service (QoS) requirements. Traditional rule-based and model-based routing methods, constrained by pre-defined rules and static network assumptions, often fail to address these complexities. This paper presents an experience-driven, model-free routing algorithm grounded in deep reinforcement learning (DRL), offering adaptive and efficient forwarding decisions. For practical deployment, we incorporate GraphTransformer networks into the DRL decision framework to enhance generalization under diverse and unseen network conditions. Specifically, we explore two element-level mapping paradigms, node-based and edge-based, to identify the optimal configuration. In addition, we design a hybrid action space that effectively incorporates domain-specific knowledge, thereby contributing to a more robust DRL agent in dynamic routing environments. Simulation results indicate that our proposed algorithms demonstrate significant robustness and generalization capabilities, revealing key principles for designing an optimal GNN-enhanced DRL-based routing algorithm.Keywords
Funding Information
- National Natural Science Foundation of China (No. 62371057)
This publication has 28 references indexed in Scilit:
- Deep reinforcement learning meets graph neural networks: Exploring a routing optimization use caseComputer Communications, 2022
- Packet Routing with Graph Attention Multi-Agent Reinforcement Learning2021
- GDDR: GNN-based Data-Driven Routing2021
- Line Graphs and Line Digraphs2021
- A Multi-agent Reinforcement Learning Perspective on Distributed Traffic Engineering2020
- INET Framework2019
- Towards the Deployment of Machine Learning Solutions in Network Traffic Classification: A Systematic SurveyIEEE Communications Surveys & Tutorials, 2018
- Experience-driven Networking: A Deep Reinforcement Learning based Approach2018
- Statistical mechanics of complex networksReviews of Modern Physics, 2002
- Some properties of line digraphsRendiconti del Circolo Matematico di Palermo Series 2, 1960