Lun Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Lun Li has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Chenxu Qian
Institute of Robotics and Automatic Information System, College of Artificial Intelligence and Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin, China
4 shared publications - Xuebo Zhang
Institute of Robotics and Automatic Information Systems and Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin, China
4 shared publications - Runhua Wang
Tianjin Key Laboratory of Intelligent Robotics, the College of Artificial Intelligence, and the Institute of Robotics and Automatic Information System, Nankai University, Tianjin, China
3 shared publications - Hang Du
College of Systems Engineering, National University of Defense Technology, Changsha, China
1 shared publication - Jing Yuan
College of Artificial Intelligence, Nankai University, Tianjin, China
1 shared publication - Minghui Zhao
Nankai University
1 shared publication
Latest Publications
- Open Access
- 28 July 2026
- Published by Elsevier in SSRN Electronic Journal
Sparsity-Regularized Adaptive Coupling for Agile Flight Control of Fixed-Wing UAVs via Reinforcement Learning
Hybridizing reinforcement learning (RL) with imitation learning (IL) is attractive for fixed-wing UAV flight control, but sparse agile-maneuver rewards can make the transition from expert guidance to autonomous policy improvement unstable. Standard two-stage methods typically rely on rigid weight-copying warm starts to avoid early exploration failures, which may restrict subsequent policy adaptation when the expert is conservative. This paper presents Sparsity-Regularized Adaptive Coupling (SRAC) , a sparse-reward-aware imitation-regularized PPO framework for agile fixed-wing control. SRAC initializes the online RL policy from scratch rather than by copying expert weights, while using a frozen expert policy and value estimator as adaptive reference anchors during sparse-reward learning. A Reward Sparsity Estimator (RSE) measures the fraction of meaningful reward events in each training batch, and an Adaptive Imitation Anchor (AIA) adjusts the imitation penalty according to this feedback reliability. A State-Action Trust Mask (SATM) further gates the anchor by comparing the current critic with the frozen expert value estimator, reducing imitation pressure in regions where the learned policy appears more promising. Experiments in the JSBSim F-16 environment indicate that SRAC improves sparse-reward training stability and achieves faster transient maneuvers than the evaluated imitation-RL and flight-control baselines. The validation remains simulation-based, and the results should be interpreted together with the reported diagnostic sensitivity sweep, safety-envelope, and failure-mode analyses.
- 28 July 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessSparsity-Regularized Adaptive Coupling for Agile Flight Control of Fixed-Wing UAVs via Reinforcement Learning
Hybridizing reinforcement learning (RL) with imitation learning (IL) is attractive for fixed-wing UAV flight control, but sparse agile-maneuver rewards can make the transition from expert guidance to autonomous policy improvement unstable. Standard two-stage methods typically rely on rigid weight-copying warm starts to avoid early exploration failures, which may restrict subsequent policy adaptation when the expert is conservative. This paper presents Sparsity-Regularized Adaptive Coupling (SRAC) , a sparse-reward-aware imitation-regularized PPO framework for agile fixed-wing control. SRAC initializes the online RL policy from scratch rather than by copying expert weights, while using a frozen expert policy and value estimator as adaptive reference anchors during sparse-reward learning. A Reward Sparsity Estimator (RSE) measures the fraction of meaningful reward events in each training batch, and an Adaptive Imitation Anchor (AIA) adjusts the imitation penalty according to this feedback reliability. A State-Action Trust Mask (SATM) further gates the anchor by comparing the current critic with the frozen expert value estimator, reducing imitation pressure in regions where the learned policy appears more promising. Experiments in the JSBSim F-16 environment indicate that SRAC improves sparse-reward training stability and achieves faster transient maneuvers than the evaluated imitation-RL and flight-control baselines. The validation remains simulation-based, and the results should be interpreted together with the reported diagnostic sensitivity sweep, safety-envelope, and failure-mode analyses.
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 56 (7) , 3689-3702
SR-GRAT: Symmetric-Response Guided Reinforcement Learning With Adaptive Targeting for Agile Fixed-Wing UAV Control
This article presents a novel curriculum framework named symmetric-response guided reinforcement learning (RL) for autopilot control of fixed-wing aircraft, driven by an adaptive bidirectional learning curve and a dynamic target scheduling mechanism. Unlike traditional methods with static or overly smoothed learning progressions, the proposed method dynamically adjusts the learning curve's slope in both directions based on historical reward trends, allowing the learning intensity to increase or decrease as needed. This bidirectional adjustment ensures that the agent is neither overwhelmed by excessively difficult tasks nor stagnated by too-easy ones, leading to better stability and faster convergence. Furthermore, dynamic target generation within an episode from static target constraints enables both reward amplification and implicit enforcement of maneuver rate constraints, improving learning efficiency without manual reward shaping. Experiments on trajectory tracking tasks show that the proposed controller achieves faster convergence, reduced overshoot, and more accurate tracking under turbulence. Further tests on waypoint navigation and dynamic pursuit demonstrate its superiority over the baseline, achieving more precise and timely interception. These results highlight the robustness and applicability of the controller to complex aerial missions such as autonomous air combat.
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 56 (7) , 3689-3702
SR-GRAT: Symmetric-Response Guided Reinforcement Learning With Adaptive Targeting for Agile Fixed-Wing UAV Control
This article presents a novel curriculum framework named symmetric-response guided reinforcement learning (RL) for autopilot control of fixed-wing aircraft, driven by an adaptive bidirectional learning curve and a dynamic target scheduling mechanism. Unlike traditional methods with static or overly smoothed learning progressions, the proposed method dynamically adjusts the learning curve's slope in both directions based on historical reward trends, allowing the learning intensity to increase or decrease as needed. This bidirectional adjustment ensures that the agent is neither overwhelmed by excessively difficult tasks nor stagnated by too-easy ones, leading to better stability and faster convergence. Furthermore, dynamic target generation within an episode from static target constraints enables both reward amplification and implicit enforcement of maneuver rate constraints, improving learning efficiency without manual reward shaping. Experiments on trajectory tracking tasks show that the proposed controller achieves faster convergence, reduced overshoot, and more accurate tracking under turbulence. Further tests on waypoint navigation and dynamic pursuit demonstrate its superiority over the baseline, achieving more precise and timely interception. These results highlight the robustness and applicability of the controller to complex aerial missions such as autonomous air combat.
- 24 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (12) , 11186-11193
LRAE: Large-Region-Aware Safe and Fast Autonomous Exploration of Ground Robots for Uneven Terrains
Ground robot autonomous exploration for uneven terrains is still challenging since the rugged terrain structures not only degrade the exploration performance but also threaten the navigation safety of the robot. In this letter, a novel exploration planner is proposed for safe and fast exploration in uneven terrains. To obtain high exploration efficiency, we propose a large-region-aware exploration route optimization strategy that prioritizes exploring large regions while also considering exploring nearby small regions. To safely and completely explore uneven terrains, our planner fully introduces traversability information to extract unknown regions and assess exploration safety levels. The safety levels are then integrated into the design of the exploration strategy to ensure safe robotic exploration. We validate our method in various challenging simulation scenes and real-world wild uneven terrains. The results show that our method can safely explore uneven terrains and improve exploration efficiency by up to 45.3% compared with state-of-the-art methods.
- 24 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (12) , 11186-11193
LRAE: Large-Region-Aware Safe and Fast Autonomous Exploration of Ground Robots for Uneven Terrains
Ground robot autonomous exploration for uneven terrains is still challenging since the rugged terrain structures not only degrade the exploration performance but also threaten the navigation safety of the robot. In this letter, a novel exploration planner is proposed for safe and fast exploration in uneven terrains. To obtain high exploration efficiency, we propose a large-region-aware exploration route optimization strategy that prioritizes exploring large regions while also considering exploring nearby small regions. To safely and completely explore uneven terrains, our planner fully introduces traversability information to extract unknown regions and assess exploration safety levels. The safety levels are then integrated into the design of the exploration strategy to ensure safe robotic exploration. We validate our method in various challenging simulation scenes and real-world wild uneven terrains. The results show that our method can safely explore uneven terrains and improve exploration efficiency by up to 45.3% compared with state-of-the-art methods.
- 16 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 8 (3) , 2182-2196
Autopilot Controller of Fixed-Wing Planes Based on Curriculum Reinforcement Learning Scheduled by Adaptive Learning Curve
In this paper, we present a novel curriculum reinforcement learning method that can automatically generate a high-performance autopilot controller for a 6-degree-of-freedom (6-DOF) aircraft with an unknown dynamic model, which is difficult to be handled using traditional control methods. In this method, a sigmoid-like learning curve is elegantly introduced to generate goals (the desired heading, altitude, and velocity) from easy to hard for autopilot. The shape of the learning curve can be intelligently adjusted to adapt to the training process of Proximal Policy Optimization (PPO). In addition, the conflict between multiple goals in autopilot training is solved by designing an adaptive reward function. Furthermore, the control inputs can avoid large oscillations by filtering the outputs from PPO with a first-order filter to ensure the smoothness. A series of simulation results show that the proposed method can not only observably improve the success rate and stability of training but also has superior performance in settling time and robustness compared with the traditional PID control and a state-of-the-art (SOTA) method. In the end, the applications of the controller, including the navigation task, pursuit-evasion, and dogfighting, are demonstrated to prove its feasibility to multiple tasks.
- 16 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 8 (3) , 2182-2196
Autopilot Controller of Fixed-Wing Planes Based on Curriculum Reinforcement Learning Scheduled by Adaptive Learning Curve
In this paper, we present a novel curriculum reinforcement learning method that can automatically generate a high-performance autopilot controller for a 6-degree-of-freedom (6-DOF) aircraft with an unknown dynamic model, which is difficult to be handled using traditional control methods. In this method, a sigmoid-like learning curve is elegantly introduced to generate goals (the desired heading, altitude, and velocity) from easy to hard for autopilot. The shape of the learning curve can be intelligently adjusted to adapt to the training process of Proximal Policy Optimization (PPO). In addition, the conflict between multiple goals in autopilot training is solved by designing an adaptive reward function. Furthermore, the control inputs can avoid large oscillations by filtering the outputs from PPO with a first-order filter to ensure the smoothness. A series of simulation results show that the proposed method can not only observably improve the success rate and stability of training but also has superior performance in settling time and robustness compared with the traditional PID control and a state-of-the-art (SOTA) method. In the end, the applications of the controller, including the navigation task, pursuit-evasion, and dogfighting, are demonstrated to prove its feasibility to multiple tasks.
- 31 January 2023
- Published by Springer Nature in Neural Computing and Applications
- Vol. 35 (14) , 10239-10255
Basic flight maneuver generation of fixed-wing plane based on proximal policy optimization
- 31 January 2023
- Published by Springer Nature in Neural Computing and Applications
- Vol. 35 (14) , 10239-10255
Basic flight maneuver generation of fixed-wing plane based on proximal policy optimization