GRouting: Dynamic Routing for LEO Satellite Networks with Graph-based Deep Reinforcement Learning
Authors:
- 25 November 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 123-128
Abstract
The effective and reliable routing for Low Earth Orbit (LEO) satellite networks is intractable. The existing approaches cannot well handle the time-varying topology, frequent link handover, and imbalanced communication load. To tackle these issues, in this paper, we propose GRouting algorithm combining Graph Neural Networks (GNN) with Deep Reinforcement Learning (DRL) to dynamically find the optimal routing paths for LEO satellite networks. First, GNN is employed to learn the representation of satellite networks with non-Euclidean data structures. GNN is able to generalize over arbitrary satellite networks topologies, which means that it can deal with time-varying states of satellite networks. Then, based on the representation learned by GNN, DRL is applied to select the optimal routing path between two satellites, which can maximize the utilization of network resources while guaranteeing the requirement of transmission delay. Finally, extensive simulation experiments are carried out to illustrate that 1) our method has a better performance than the baseline algorithms, and 2) the GNN-based method can achieve better generalization over time-varying topologies.Keywords
This publication has 9 references indexed in Scilit:
- Topology Virtualization and Dynamics Shielding Method for LEO Satellite NetworksIEEE Communications Letters, 2019
- A Two-Hops State-Aware Routing Strategy Based on Deep Reinforcement Learning for LEO Satellite NetworksElectronics, 2019
- Intelligent Routing Scheme for SDN Satellite Network Based on Neural NetworkIOP Conference Series: Materials Science and Engineering, 2019
- Ultra-Dense LEO: Integration of Satellite Access Networks into 5G and BeyondIEEE Wireless Communications, 2019
- Temporal Netgrid Model-Based Dynamic Routing in Large-Scale Small Satellite NetworksIEEE Transactions on Vehicular Technology, 2019
- A load balanced routing algorithm based on congestion prediction for LEO satellite networksCluster Computing, 2017
- Routing Algorithm with Virtual Topology Toward to Huge Numbers of LEO Mobile Satellite Network Based on SDNMobile Networks and Applications, 2017
- Human-level control through deep reinforcement learningNature, 2015
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008