Toward the Age in Forwarding: A Deep Reinforcement Learning Enabled Routing Mechanism for Large-Scale Satellite Networks via Spatial–Temporal Graph Neural Networks
- 15 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Networking
- Vol. 34, 292-307
Abstract
In large-scale satellite networks, end-to-end data delivery confronts long propagation latency and dynamical connectivity, heavily challenging current routing strategies due to the time-changing topology. For the tasks with high timeliness requirements, especially, it will cause obviously low freshness of data since huge computational cost and transmission overhead are required for implementing optimal routing decisions. To address this issue, in this paper, we propose an Age-driven Deep Reinforcement Learning (DRL) enabled Routing Mechanism (ADRLRM) for the large-scale satellite network by considering the impact of time-varying topology on the timeliness of data, in which a Parameter-adjustable Two-step Slotting Algorithm (PTSA)-assisted Spatial-Temporal Graph Neural Network (STGNN) is well-designed to extract the topological features both in temporal and spatial dimensions. In particular, we develop a novel metric of data freshness called Routing-aware Age of Information (RAoI) to evaluate the timeliness of data delivery, which is incorporated into the customized reward function of the proposed mechanism as an optimization objective. The simulation results indicate that the proposed mechanism performs better in reducing the end-to-end delivery latency, number of forwarding hops, and average RAoI compared with the conventional Open Shortest Path First (OSPF) routing algorithm, Deep Q-Networks based Intelligent Routing (DQN-IR), and GNN-based GraphPR routing algorithm, respectively.Keywords
Funding Information
- National Natural Science Foundation of China (62371158)
- National Natural Science Foundation of China (62027802)
- Major Key Project of PCL (PCL2024A01)
This publication has 41 references indexed in Scilit:
- Semantic LTP: An Age-Optimal Bundle Delivery Mechanism in Space Disruption-Tolerant NetworksIEEE Journal on Selected Areas in Communications, 2024
- Flowlet-Level Routing Optimization with GNN-Based Multi-Agent Deep Reinforcement Learning2023
- Unreliable Multi-hop Networks Routing Protocol For Age of Information-Sensitive Communication2022
- Applying Graph Neural Network in Deep Reinforcement Learning to Optimize Wireless Network Routing2022
- GRouting: Dynamic Routing for LEO Satellite Networks with Graph-based Deep Reinforcement Learning2021
- Average AoI Minimization in UAV-Assisted Data Collection With RF Wireless Power Transfer: A Deep Reinforcement Learning SchemeIEEE Internet of Things Journal, 2021
- Age of Information: An Introduction and SurveyIEEE Journal on Selected Areas in Communications, 2021
- RouteNet: Leveraging Graph Neural Networks for Network Modeling and Optimization in SDNIEEE Journal on Selected Areas in Communications, 2020
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- Divide and conquer: Partitioning OSPF networks with SDN2015