Youkun Peng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Youkun Peng has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Gang Feng
National Key Laboratory of Wireless Communications, University of Electronic Science and Technology of China, Chengdu, China
5 shared publications - Shuang Qin
National Key Laboratory of Science and Technology on Communications, University of Electronic Science and Technology of China, Chengdu, China
5 shared publications - Fengsheng Wei
National Key Laboratory of Science and Technology on Communications, University of Electronic Science and Technology of China, Chengdu, China
2 shared publications - Jian Wang
National Key Laboratory of Wireless Communications, University of Electronic Science and Technology of China, Chengdu, China
2 shared publications - Lei Cheng
National Key Laboratory of Wireless Communications, University of Electronic Science and Technology of China, Chengdu, China
2 shared publications - Long Zhang
Sichuan Energy Internet Research Institute, Tsinghua University, Chengdu, China
2 shared publications
Latest Publications
- 24 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (11) , 18096-18111
Access Control in Satellite–Terrestrial Backhaul Network: An Emergent Communication Based Multi-Agent Reinforcement Learning Approach
The satellite-terrestrial backhaul network (STBN) has recently emerged as a promising architecture to provide cost-effective seamless communication services to mobile users, especially in remote areas. In such networks, limited backhaul capacity, dynamic channel states, and user mobility pose significant challenges to user access control, involving efficient channel allocation and interference coordination to maximize user quality of service and network resource utilization. This dynamic user access problem can be formulated as a sequential decision process, and thus multi-agent reinforcement learning (MARL) can be a potential solution. However, conventional MARL lacks cooperation mechanisms for accurate state inference, which is critical for making optimal and cooperative resource allocation and interference management actions in such a dynamic and resource-constrained STBN. Moreover, although centralized coordination may improve system performance, it raises privacy and scalability concerns. In this paper, we propose a decentralized cooperative user access strategy, by leveraging emergent communication based MARL (EC-MARL). EC-MARL incorporates an emergent communication mechanism into the MARL framework, enabling user equipments (UEs) to cooperatively infer the network state more accurately while preserving privacy and scalability. Specifically, each agent encodes its local observation into a cooperation message, and shares the message among other agents. Based on these shared messages and their own local observations, UEs cooperatively make access decisions. Simulation results demonstrate that the proposed EC-MARL approach significantly outperforms several benchmarks in various network settings.
- 24 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (11) , 18096-18111
Access Control in Satellite–Terrestrial Backhaul Network: An Emergent Communication Based Multi-Agent Reinforcement Learning Approach
The satellite-terrestrial backhaul network (STBN) has recently emerged as a promising architecture to provide cost-effective seamless communication services to mobile users, especially in remote areas. In such networks, limited backhaul capacity, dynamic channel states, and user mobility pose significant challenges to user access control, involving efficient channel allocation and interference coordination to maximize user quality of service and network resource utilization. This dynamic user access problem can be formulated as a sequential decision process, and thus multi-agent reinforcement learning (MARL) can be a potential solution. However, conventional MARL lacks cooperation mechanisms for accurate state inference, which is critical for making optimal and cooperative resource allocation and interference management actions in such a dynamic and resource-constrained STBN. Moreover, although centralized coordination may improve system performance, it raises privacy and scalability concerns. In this paper, we propose a decentralized cooperative user access strategy, by leveraging emergent communication based MARL (EC-MARL). EC-MARL incorporates an emergent communication mechanism into the MARL framework, enabling user equipments (UEs) to cooperatively infer the network state more accurately while preserving privacy and scalability. Specifically, each agent encodes its local observation into a cooperation message, and shares the message among other agents. Based on these shared messages and their own local observations, UEs cooperatively make access decisions. Simulation results demonstrate that the proposed EC-MARL approach significantly outperforms several benchmarks in various network settings.
- 24 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (8) , 12879-12894
Cooperative Transmission for Space-Air-Ground Integrated Networks: A Multi-Agent Cooperation Method
Unmanned aerial vehicles (UAVs) have been widely applied as aerial relays for satellite-to-terrestrial transmission so that data packets can be delivered either directly from satellites to user equipments (UEs) or relayed via UAVs. To exploit the advantages of such space-aerial cooperative transmission, data transmission, and resource allocation should be jointly optimized under constrained resources in dynamic space-air-ground integrated networks (SAGINs). However, the tight coupling between discrete transmission strategies and continuous resource allocation among users leads to a challenging long-term, large-scale, and non-convex optimization problem. While existing multi-agent reinforcement learning (MARL) techniques have exhibited potential in addressing such problems, their limitations in handling discrete-continuous decisions and ensuring robust multi-agent cooperation often result in significant performance deterioration. In this paper, we propose a new MARL-based Cooperative Transmission Strategy (MCTS) to overcome these limitations. In MCTS, each agent employs a hybrid Actor-Critic (H-AC) algorithm, where the optimal discrete transmission strategy with its associated resource allocation is modeled as parameterized actions and determined by an improved AC structure. To enhance cooperation among agents, a multi-agent cooperation framework is designed based on QMIX, employing a centralized Critic to efficiently guide convergence toward optimal solutions while reducing computational complexity. Simulation results demonstrate the superiority of MCTS over a number of benchmark algorithms and efficiency under various environments, in terms of overall transmitted data and resource utilization.
- 24 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (8) , 12879-12894
Cooperative Transmission for Space-Air-Ground Integrated Networks: A Multi-Agent Cooperation Method
Unmanned aerial vehicles (UAVs) have been widely applied as aerial relays for satellite-to-terrestrial transmission so that data packets can be delivered either directly from satellites to user equipments (UEs) or relayed via UAVs. To exploit the advantages of such space-aerial cooperative transmission, data transmission, and resource allocation should be jointly optimized under constrained resources in dynamic space-air-ground integrated networks (SAGINs). However, the tight coupling between discrete transmission strategies and continuous resource allocation among users leads to a challenging long-term, large-scale, and non-convex optimization problem. While existing multi-agent reinforcement learning (MARL) techniques have exhibited potential in addressing such problems, their limitations in handling discrete-continuous decisions and ensuring robust multi-agent cooperation often result in significant performance deterioration. In this paper, we propose a new MARL-based Cooperative Transmission Strategy (MCTS) to overcome these limitations. In MCTS, each agent employs a hybrid Actor-Critic (H-AC) algorithm, where the optimal discrete transmission strategy with its associated resource allocation is modeled as parameterized actions and determined by an improved AC structure. To enhance cooperation among agents, a multi-agent cooperation framework is designed based on QMIX, employing a centralized Critic to efficiently guide convergence toward optimal solutions while reducing computational complexity. Simulation results demonstrate the superiority of MCTS over a number of benchmark algorithms and efficiency under various environments, in terms of overall transmitted data and resource utilization.
- 12 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Selected Areas in Communications
- Vol. 42 (12) , 3705-3718
Hierarchical Network Slicing for UAV-Assisted Wireless Networks With Deployment Optimization
Unmanned aerial vehicle (UAV) has been recognized as a key supplement for terrestrial networks to meet the stringent requirements of the forthcoming 6G networks. However, a significant challenge lies in providing differentiated services through a common UAV network, without the need to deploy individual networks for each service type. In this paper, we consider the problem of joint network slicing and UAV deployment under dynamic wireless environments as well as the uncertain traffic demands. To overcome the challenges posed by the network dynamics, we propose an intelligent hierarchical UAV slicing framework that operates at two different time-scales. At the large time-scale, the problem of inter-slice resource slicing and UAV deployment is formulated as a mixed integer nonlinear program, and a decomposition technique is applied to resolve it. At the small time-scale, the problem of intra-slice resource adjustment is modeled as a stochastic game and a distributed learning algorithm is proposed to find its Nash Equilibrium. Simulation results demonstrate that the proposed framework is lightweight and outperforms a number of known benchmark algorithms in terms of system utility, throughput and transmission delay.
- 12 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Selected Areas in Communications
- Vol. 42 (12) , 3705-3718
Hierarchical Network Slicing for UAV-Assisted Wireless Networks With Deployment Optimization
Unmanned aerial vehicle (UAV) has been recognized as a key supplement for terrestrial networks to meet the stringent requirements of the forthcoming 6G networks. However, a significant challenge lies in providing differentiated services through a common UAV network, without the need to deploy individual networks for each service type. In this paper, we consider the problem of joint network slicing and UAV deployment under dynamic wireless environments as well as the uncertain traffic demands. To overcome the challenges posed by the network dynamics, we propose an intelligent hierarchical UAV slicing framework that operates at two different time-scales. At the large time-scale, the problem of inter-slice resource slicing and UAV deployment is formulated as a mixed integer nonlinear program, and a decomposition technique is applied to resolve it. At the small time-scale, the problem of intra-slice resource adjustment is modeled as a stochastic game and a distributed learning algorithm is proposed to find its Nash Equilibrium. Simulation results demonstrate that the proposed framework is lightweight and outperforms a number of known benchmark algorithms in terms of system utility, throughput and transmission delay.
- 10 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 11 (2) , 1316-1331
Online Learning-Based Joint Gateway Selection and User Scheduling in Non-Stationary Air-Ground Networks
Air-ground networks have emerged as a promising paradigm for enhancing mobile user coverage and quality of service. In such networks, the system needs to select appropriate gateways as relays between ground and air, and meanwhile schedule user transmissions. Due to the heterogeneity of radio access technologies, the joint gateway selection and user scheduling (GSUS) becomes a crucial yet challenging problem for maximizing network resource utilization. However, when terrestrial users access the continuously moving aerial access point, the ground-to-air channel state becomes dynamic and non-stationary, which reduces the effectiveness of optimization-based techniques and conventional Reinforcement Learning (RL) methods for solving the GSUS problem. In this paper, we design an intelligent GSUS (iGSUS) scheme by incorporating representation learning into the RL framework to tackle the non-stationarity. Specifically, we use Dynamic Parameter Markov Decision Process to decompose the non-stationary MDP into a sequence of stationary MDPs. These MDPs are encoded with latent parameters by representation learning, enabling the RL algorithm to efficiently learn and exploit appropriate GSUS policies in an online learning manner. Simulation results show that the proposed iGSUS scheme is significantly better than several benchmarks in utility, average network throughput and packet loss rate, showcasing its adaptability in non-stationary air-ground networks.
- 10 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 11 (2) , 1316-1331
Online Learning-Based Joint Gateway Selection and User Scheduling in Non-Stationary Air-Ground Networks
Air-ground networks have emerged as a promising paradigm for enhancing mobile user coverage and quality of service. In such networks, the system needs to select appropriate gateways as relays between ground and air, and meanwhile schedule user transmissions. Due to the heterogeneity of radio access technologies, the joint gateway selection and user scheduling (GSUS) becomes a crucial yet challenging problem for maximizing network resource utilization. However, when terrestrial users access the continuously moving aerial access point, the ground-to-air channel state becomes dynamic and non-stationary, which reduces the effectiveness of optimization-based techniques and conventional Reinforcement Learning (RL) methods for solving the GSUS problem. In this paper, we design an intelligent GSUS (iGSUS) scheme by incorporating representation learning into the RL framework to tackle the non-stationarity. Specifically, we use Dynamic Parameter Markov Decision Process to decompose the non-stationary MDP into a sequence of stationary MDPs. These MDPs are encoded with latent parameters by representation learning, enabling the RL algorithm to efficiently learn and exploit appropriate GSUS policies in an online learning manner. Simulation results show that the proposed iGSUS scheme is significantly better than several benchmarks in utility, average network throughput and packet loss rate, showcasing its adaptability in non-stationary air-ground networks.
- 2 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (12) , 18846-18862
Intelligent Beam Configuration for Neighbor Discovery in Ad Hoc Networks With Directional Antennas
High frequency directional communication is considered as key technology to improve the performance of mobile Ad Hoc networks owing to its advantages in terms of communication distance and low interference. Neighbor discovery plays a key role for efficient routing and topology control in mobile Ad Hoc networks. It is also a very challenging issue due to the use of directional antennas and the movement of mobile nodes. Beam configuration is the core step of neighbor discovery in mobile Ad Hoc networks with directional antennas. Therefore, it is imperative to develop an efficient beam configuration algorithm to reduce the neighbor discovery latency. In this paper, we propose a novel beam configuration algorithm based on personalized federated learning. Considering the characteristics of mobile Ad Hoc networks (e.g., dynamic topology and directional communication), we use Deep Deterministic Policy Gradient (DDPG) as the local model of federated learning. Since the local data of Ad Hoc network nodes is heterogeneous, Model Agnostic Meta Learning (MAML) is applied to personalize the federated learning. Numerical results demonstrate that our proposed algorithm has better performance than some baseline algorithms
- 2 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (12) , 18846-18862
Intelligent Beam Configuration for Neighbor Discovery in Ad Hoc Networks With Directional Antennas
High frequency directional communication is considered as key technology to improve the performance of mobile Ad Hoc networks owing to its advantages in terms of communication distance and low interference. Neighbor discovery plays a key role for efficient routing and topology control in mobile Ad Hoc networks. It is also a very challenging issue due to the use of directional antennas and the movement of mobile nodes. Beam configuration is the core step of neighbor discovery in mobile Ad Hoc networks with directional antennas. Therefore, it is imperative to develop an efficient beam configuration algorithm to reduce the neighbor discovery latency. In this paper, we propose a novel beam configuration algorithm based on personalized federated learning. Considering the characteristics of mobile Ad Hoc networks (e.g., dynamic topology and directional communication), we use Deep Deterministic Policy Gradient (DDPG) as the local model of federated learning. Since the local data of Ad Hoc network nodes is heterogeneous, Model Agnostic Meta Learning (MAML) is applied to personalize the federated learning. Numerical results demonstrate that our proposed algorithm has better performance than some baseline algorithms