JLJiaxin Li

Jiaxin Li

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jiaxin Li has a total of 6 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Hierarchical DDPG Based Reinforcement Learning Framework for Multi-Agent Collective Motion With Short Communication Ranges

    by Jiaxin Li, Peng Yi, Tong Duan, Zhen Zhang, Tao Hu

    Collective motion is an important research content in the multi-agent control field. However, existing multi-agent collective motion methods typically assume large communication ranges of individual agents; in the scenario of leader-follower control with short communication ranges, if the leader dynamically changes its velocity without considering the followers’ states, the communication topology may be easily disconnected, making multi-agent collective motion more challenging. In this work, a novel Hierarchical DeepDeterministic PolicyGradient (HDDPG) based reinforcement learning framework is proposed to realize multi-agent collective motion with short communication ranges, ensuring the communication topology connected as much as possible. In H-DDPG, multiple agents with one single leader and numerous followers are dynamically divided into several hierarchies to conduct distributed control when the leader’s velocity changes. Two algorithms based on DDPG and the hierarchical strategy are designed to train followers in the first layer and followers in layers other than the first layer separately, which ensures that the agents form a tight swarm from scattered distribution and all followers can track the leader effectively. The experimental results demonstrate that with short communication ranges, H-DDPG outperforms the hierarchical flocking method in keeping the communication topology connection and shaping a tighter swarm.


  • Centroid-Guided Target-Driven Topology Control Method for UAV Ad-Hoc Networks Based on Tiny Deep Reinforcement Learning Algorithm

    by Jiaxin Li, Peng Yi, Tong Duan, Yawen Wang, Zhen Zhang, Jing Yu, Tao Hu

    Due to the high mobility of unmanned aerial vehicles (UAVs), the network topology may change frequently, making persistent connectivity and fault tolerance difficult. Deep reinforcement learning (DRL) offers the opportunity to make proper actions in a large decision space, which could be utilized for the complicated topology control of flying ad-hoc networks. However, how to train and deploy the DRL algorithms on resource-limited and hardware-constrained UAVs to ensure network connectivity and fault tolerance still faces huge challenges. In this work, a topology control method based on positional movement and DRL is proposed, which is suitable for topology construction and topology adjustment. First, a centroid-guided target-driven method is designed to transform arbitrary graphs into 2-connected graphs by connecting each node with its two designated target nodes in a specific order. Then, a topology control method based on the centroid-guided target-driven method and soft actor–critic (CGTD-SAC) is proposed. CGTD-SAC trains agents to keep connectivity with two target agents and keep a safe distance from surrounding agents. CGTD-SAC generates 2-connected topologies in a distributed manner. CGTD-SAC is a tiny algorithm with low computational complexity and less communication overhead. Finally, experiments demonstrate that CGTD-SAC has an excellent ability to obtain network topologies with 2-connectivity, suitable link length, and appropriate number of links.