JLJizhao Lei

Jizhao Lei

*This is an algorithmically generated author record based on publicly available information.

Jizhao Lei has a total of 5 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Fully-Distributed Dynamic Packet Routing for LEO Satellite Networks: A GNN-Enhanced Multi-Agent Reinforcement Learning Approach

    by Yongyi Ran, Yajie Ding, Shuangwu Chen, Jizhao Lei, Jiangtao Luo

    An efficient routing strategy in Low Earth Orbit (LEO) satellite networks is critical for air-space-ground integrated communication towards 6G. However, the existing terrestrial routing algorithms cannot well handle the high-speed movement issue of satellites, while the existing satellite routing algorithms usually suffer from high communication overhead or high computational complexity. To address the above issues, we propose a fully distributed dynamic packet routing algorithm based on Graph Neural Network (GNN)-enhanced Multi-Agent Deep Reinforcement Learning (MADRL), named GraphPR. In GraphPR, the satellite routing problem is modeled as a Partially Observable Markov Decision Process (POMDP), where each satellite only needs to share the information with one-hop neighbors. Then, Graph Attention Network (GAT) is leveraged to encode the perceived one-hop information and derive a hidden representation implicitly consisting of multi-hop satellite information. Subsequently, MADRL is employed to build a fully distributed optimization framework and make routing decisions. In addition, a special mechanism called Residual Shortest Path Hops (RSPH) is designed to guide the routing selection and avoid routing loops. Finally, the experimental results illustrate that GraphPR has better performance in terms of packet loss rate, average delivery time, throughput, and average queuing length than the baseline algorithms.


  • Towards Beam Hopping and Power Allocation in Multi-Beam Satellite Systems With Parameterized Reinforcement Learning

    by Yongyi Ran, Feng Tan, Shuangwu Chen, Jizhao Lei, Jiangtao Luo

    The simultaneous optimisation of beam hopping and power allocation is a crucial technique for enhancing the performance of Multi-Beam Satellite (MBS) systems. However, the previous joint optimisation approaches cannot well handle with the issues of high-dimensional state space and discrete-continuous hybrid action space. In this paper, we propose a joint optimization approach based on parameterized reinforcement learning to simultaneously regulate beam hopping and power allocation for MBS systems (called DeepMBS). In DeepMBS, a multi-objective problem is firstly formulated to optimize system throughput and energy efficiency. Then, the optimization problem is modelled as a Markov Decision Process (MDP), and the original deep Q-network is extended with a parameterized action space to simultaneously determine the beam hopping (discrete action) and power allocation (continuous action). In addition, we design an empirical filtering mechanism to enhance the performance of DeepMBS. Finally, the results of extensive experiments demonstrate that the proposed DeepMBS can gain a better performance in terms of throughput and energy efficiency compared to the baseline algorithms. Furthermore, the proposed DeepMBS (EFM) algorithm demonstrates superior accuracy and sensitivity in capturing changes of communication demands.