Qijie Zhou
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Qijie Zhou has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Qing Shi
Beijing Institute of Technology
4 shared publications - Yi Xu
Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
3 shared publications - Weitao Zhang
Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
2 shared publications - Chun-Yi Su
School of Automation, Guangdong Province Key Laboratory of Intelligent Decision and Cooperative Control, Guangdong University of Technology, Guangzhou, China
1 shared publication Gangyang Li
Beijing Institute of Technology, 5 Zhongguancun South Street, Haidian District 100081, Beijing, Beijing, Beijing, 100081, CHINA
1 shared publication- Gangyang Li
Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
1 shared publication
Latest Publications
- 14 November 2025
- Published by IOP Publishing in Bioinspiration & Biomimetics
- Vol. 20 (6) , 066018
Path planning of locust-inspired jumping robots in obstacle-dense environments using curriculum reinforcement learning
Biologically-inspired jumping robots have demonstrated remarkable adaptability in complex environments, making them increasingly valuable across various fields. However, effective path planning in obstacle-dense environments for large-scale jumping robots remains a significant challenge. Inspired by independent decision-making in the efficient collaborative behavior of locust swarms, we propose a two-stage curriculum reinforcement learning (TS-CRL) framework for locust-inspired jumping robots. This framework enables individual robots to autonomously determine actions based on local environmental observations during group crossing tasks. TS-CRL incorporates a population-invariant encoder with an attention mechanism, allowing it to efficiently handle an increased number of training robots. Moreover, it employs an actor-critic network architecture based on Kolmogorov–Arnold networks to enhance training performance. To further improve the training efficiency, we divided the policy training process into two stages with gradually increasing environmental complexity. The effectiveness and scalability of TS-CRL were validated through a locust-inspired jumping robot platform in challenging simulation scenarios. Notably, TS-CRL can generate efficient, collision-free paths to guide multiple jumping robots. Compared with typical reinforcement learning algorithms, TS-CRL reduced the average path cost by 13.7% and markedly improved the success rate of robots in reaching the target areas. Finally, we constructed a multi-robot system consisting of locust-inspired jumping robots for experiments in the real world.
- 14 November 2025
- Published by IOP Publishing in Bioinspiration & Biomimetics
- Vol. 20 (6) , 066018
Path planning of locust-inspired jumping robots in obstacle-dense environments using curriculum reinforcement learning
Biologically-inspired jumping robots have demonstrated remarkable adaptability in complex environments, making them increasingly valuable across various fields. However, effective path planning in obstacle-dense environments for large-scale jumping robots remains a significant challenge. Inspired by independent decision-making in the efficient collaborative behavior of locust swarms, we propose a two-stage curriculum reinforcement learning (TS-CRL) framework for locust-inspired jumping robots. This framework enables individual robots to autonomously determine actions based on local environmental observations during group crossing tasks. TS-CRL incorporates a population-invariant encoder with an attention mechanism, allowing it to efficiently handle an increased number of training robots. Moreover, it employs an actor-critic network architecture based on Kolmogorov–Arnold networks to enhance training performance. To further improve the training efficiency, we divided the policy training process into two stages with gradually increasing environmental complexity. The effectiveness and scalability of TS-CRL were validated through a locust-inspired jumping robot platform in challenging simulation scenarios. Notably, TS-CRL can generate efficient, collision-free paths to guide multiple jumping robots. Compared with typical reinforcement learning algorithms, TS-CRL reduced the average path cost by 13.7% and markedly improved the success rate of robots in reaching the target areas. Finally, we constructed a multi-robot system consisting of locust-inspired jumping robots for experiments in the real world.
- 25 July 2025
- Published by Elsevier in Expert Systems with Applications
- Vol. 296
Efficient deployment of multiple jumping robots in uneven terrains using deep reinforcement learning
- 25 July 2025
- Published by Elsevier in Expert Systems with Applications
- Vol. 296
Efficient deployment of multiple jumping robots in uneven terrains using deep reinforcement learning
- 19 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 41 (15523098) , 220-235
A Locust-Inspired Robot Capable of Continuous Crawl–Jump–Gliding Locomotion With Optimized Transitional Control
Locusts have various motion modes among which they continuously switch in terrestrial and aerial domains, hence achieving high environmental adaptability. Several robots have been developed to mimic the jump–gliding locomotion of locusts, but their mobility and transitional stability are limited because of structural and control limitations at a small scale. In this article, we develop a small-scale locust-inspired robot (LocustBot) that can not only jump and glide but also crawl. We propose a coordinately actuated mechanism that allows LocustBot to perform jump–gliding with few actuators. To achieve the stable and long-distance moving, a reinforcement-learning-based optimized control is used to generate then track the robot's position and orientation from take-off to landing. The jump–gliding distance of LocustBot reaches 5.39 m, revealing a high-energy utilization efficiency of the mobile strategy, which combines the spring-driven jumping with the propeller-driven gliding. Remarkably, without a high platform, the robot can still achieve a far moving range by continuous crawl–jump–gliding on horizontal planes and, thus, outperforms the state-of-art jump–gliding robots.
- 19 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 41 (15523098) , 220-235
A Locust-Inspired Robot Capable of Continuous Crawl–Jump–Gliding Locomotion With Optimized Transitional Control
Locusts have various motion modes among which they continuously switch in terrestrial and aerial domains, hence achieving high environmental adaptability. Several robots have been developed to mimic the jump–gliding locomotion of locusts, but their mobility and transitional stability are limited because of structural and control limitations at a small scale. In this article, we develop a small-scale locust-inspired robot (LocustBot) that can not only jump and glide but also crawl. We propose a coordinately actuated mechanism that allows LocustBot to perform jump–gliding with few actuators. To achieve the stable and long-distance moving, a reinforcement-learning-based optimized control is used to generate then track the robot's position and orientation from take-off to landing. The jump–gliding distance of LocustBot reaches 5.39 m, revealing a high-energy utilization efficiency of the mobile strategy, which combines the spring-driven jumping with the propeller-driven gliding. Remarkably, without a high platform, the robot can still achieve a far moving range by continuous crawl–jump–gliding on horizontal planes and, thus, outperforms the state-of-art jump–gliding robots.
- Open Access
- 11 September 2024
- Published by MDPI AG in Biomimetics
- Vol. 9 (9) , 548
Stable Jumping Control Based on Deep Reinforcement Learning for a Locust-Inspired Robot
Biologically inspired jumping robots exhibit exceptional movement capabilities and can quickly overcome obstacles. However, the stability and accuracy of jumping movements are significantly compromised by rapid changes in posture. Here, we propose a stable jumping control algorithm for a locust-inspired jumping robot based on deep reinforcement learning. The algorithm utilizes a training framework comprising two neural network modules (actor network and critic network) to enhance training performance. The framework can control jumping by directly mapping the robot’s observations (robot position and velocity, obstacle position, target position, etc.) to its joint torques. The control policy increases randomness and exploration by introducing an entropy term to the policy function. Moreover, we designed a stage incentive mechanism to adjust the reward function dynamically, thereby improving the robot’s jumping stability and accuracy. We established a locus-inspired jumping robot platform and conducted a series of jumping experiments in simulation. The results indicate that the robot could perform smooth and non-flip jumps, with the error of the distance from the target remaining below 3%. The robot consumed 44.6% less energy to travel the same distance by jumping compared with walking. Additionally, the proposed algorithm exhibited a faster convergence rate and improved convergence effects compared with other classical algorithms.
- 11 September 2024
- Published by MDPI AG in Biomimetics
- Vol. 9 (9) , 548
Open AccessStable Jumping Control Based on Deep Reinforcement Learning for a Locust-Inspired Robot
Biologically inspired jumping robots exhibit exceptional movement capabilities and can quickly overcome obstacles. However, the stability and accuracy of jumping movements are significantly compromised by rapid changes in posture. Here, we propose a stable jumping control algorithm for a locust-inspired jumping robot based on deep reinforcement learning. The algorithm utilizes a training framework comprising two neural network modules (actor network and critic network) to enhance training performance. The framework can control jumping by directly mapping the robot’s observations (robot position and velocity, obstacle position, target position, etc.) to its joint torques. The control policy increases randomness and exploration by introducing an entropy term to the policy function. Moreover, we designed a stage incentive mechanism to adjust the reward function dynamically, thereby improving the robot’s jumping stability and accuracy. We established a locus-inspired jumping robot platform and conducted a series of jumping experiments in simulation. The results indicate that the robot could perform smooth and non-flip jumps, with the error of the distance from the target remaining below 3%. The robot consumed 44.6% less energy to travel the same distance by jumping compared with walking. Additionally, the proposed algorithm exhibited a faster convergence rate and improved convergence effects compared with other classical algorithms.
- 1 August 1990
- Published by Elsevier in IFAC Proceedings Volumes
- Vol. 23 (8) , 117-120
A Novel Variable Structure Control Scheme for Robot Trajectory Control
- 1 August 1990
- Published by Elsevier in IFAC Proceedings Volumes
- Vol. 23 (8) , 117-120
A Novel Variable Structure Control Scheme for Robot Trajectory Control