Jiaxin Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jiaxin Li has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Peng Yi
Information Engineering University, Zhengzhou, China
2 shared publications - Tao Hu
Information Engineering University, Zhengzhou, China
2 shared publications - Tong Duan
Information Engineering University, Zhengzhou, China
2 shared publications Zhen Zhang
Department of Information and Communication Engineering, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
2 shared publications- Jing Yu
Department of Information Communication Engineering, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
1 shared publication - Yawen Wang
PLA Strategic Support Force Information Engineering University, Zhengzhou, China
1 shared publication
Latest Publications
- Open Access
- 13 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Machine Learning in Communications and Networking
- Vol. 2, 633-644
Hierarchical DDPG Based Reinforcement Learning Framework for Multi-Agent Collective Motion With Short Communication Ranges
Collective motion is an important research content in the multi-agent control field. However, existing multi-agent collective motion methods typically assume large communication ranges of individual agents; in the scenario of leader-follower control with short communication ranges, if the leader dynamically changes its velocity without considering the followers’ states, the communication topology may be easily disconnected, making multi-agent collective motion more challenging. In this work, a novel Hierarchical DeepDeterministic PolicyGradient (HDDPG) based reinforcement learning framework is proposed to realize multi-agent collective motion with short communication ranges, ensuring the communication topology connected as much as possible. In H-DDPG, multiple agents with one single leader and numerous followers are dynamically divided into several hierarchies to conduct distributed control when the leader’s velocity changes. Two algorithms based on DDPG and the hierarchical strategy are designed to train followers in the first layer and followers in layers other than the first layer separately, which ensures that the agents form a tight swarm from scattered distribution and all followers can track the leader effectively. The experimental results demonstrate that with short communication ranges, H-DDPG outperforms the hierarchical flocking method in keeping the communication topology connection and shaping a tighter swarm.
- 13 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Machine Learning in Communications and Networking
- Vol. 2, 633-644
Open AccessHierarchical DDPG Based Reinforcement Learning Framework for Multi-Agent Collective Motion With Short Communication Ranges
Collective motion is an important research content in the multi-agent control field. However, existing multi-agent collective motion methods typically assume large communication ranges of individual agents; in the scenario of leader-follower control with short communication ranges, if the leader dynamically changes its velocity without considering the followers’ states, the communication topology may be easily disconnected, making multi-agent collective motion more challenging. In this work, a novel Hierarchical DeepDeterministic PolicyGradient (HDDPG) based reinforcement learning framework is proposed to realize multi-agent collective motion with short communication ranges, ensuring the communication topology connected as much as possible. In H-DDPG, multiple agents with one single leader and numerous followers are dynamically divided into several hierarchies to conduct distributed control when the leader’s velocity changes. Two algorithms based on DDPG and the hierarchical strategy are designed to train followers in the first layer and followers in layers other than the first layer separately, which ensures that the agents form a tight swarm from scattered distribution and all followers can track the leader effectively. The experimental results demonstrate that with short communication ranges, H-DDPG outperforms the hierarchical flocking method in keeping the communication topology connection and shaping a tighter swarm.
- 13 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (12) , 21083-21091
Centroid-Guided Target-Driven Topology Control Method for UAV Ad-Hoc Networks Based on Tiny Deep Reinforcement Learning Algorithm
Due to the high mobility of unmanned aerial vehicles (UAVs), the network topology may change frequently, making persistent connectivity and fault tolerance difficult. Deep reinforcement learning (DRL) offers the opportunity to make proper actions in a large decision space, which could be utilized for the complicated topology control of flying ad-hoc networks. However, how to train and deploy the DRL algorithms on resource-limited and hardware-constrained UAVs to ensure network connectivity and fault tolerance still faces huge challenges. In this work, a topology control method based on positional movement and DRL is proposed, which is suitable for topology construction and topology adjustment. First, a centroid-guided target-driven method is designed to transform arbitrary graphs into 2-connected graphs by connecting each node with its two designated target nodes in a specific order. Then, a topology control method based on the centroid-guided target-driven method and soft actor–critic (CGTD-SAC) is proposed. CGTD-SAC trains agents to keep connectivity with two target agents and keep a safe distance from surrounding agents. CGTD-SAC generates 2-connected topologies in a distributed manner. CGTD-SAC is a tiny algorithm with low computational complexity and less communication overhead. Finally, experiments demonstrate that CGTD-SAC has an excellent ability to obtain network topologies with 2-connectivity, suitable link length, and appropriate number of links.
- 13 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (12) , 21083-21091
Centroid-Guided Target-Driven Topology Control Method for UAV Ad-Hoc Networks Based on Tiny Deep Reinforcement Learning Algorithm
Due to the high mobility of unmanned aerial vehicles (UAVs), the network topology may change frequently, making persistent connectivity and fault tolerance difficult. Deep reinforcement learning (DRL) offers the opportunity to make proper actions in a large decision space, which could be utilized for the complicated topology control of flying ad-hoc networks. However, how to train and deploy the DRL algorithms on resource-limited and hardware-constrained UAVs to ensure network connectivity and fault tolerance still faces huge challenges. In this work, a topology control method based on positional movement and DRL is proposed, which is suitable for topology construction and topology adjustment. First, a centroid-guided target-driven method is designed to transform arbitrary graphs into 2-connected graphs by connecting each node with its two designated target nodes in a specific order. Then, a topology control method based on the centroid-guided target-driven method and soft actor–critic (CGTD-SAC) is proposed. CGTD-SAC trains agents to keep connectivity with two target agents and keep a safe distance from surrounding agents. CGTD-SAC generates 2-connected topologies in a distributed manner. CGTD-SAC is a tiny algorithm with low computational complexity and less communication overhead. Finally, experiments demonstrate that CGTD-SAC has an excellent ability to obtain network topologies with 2-connectivity, suitable link length, and appropriate number of links.