Precise aggressive aerial maneuvers with sensorimotor policies
- 10 June 2026
- journal article
- research article
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 11 (115) , eaeb0180
Abstract
Precise aggressive maneuvers with lightweight onboard sensors remain a key bottleneck in fully exploiting the maneuverability of drones. Such maneuvers are critical for expanding the systems’ accessible area by navigating through narrow openings in the environment. One of the most relevant problems is aggressive traversal through narrow gaps with quadrotors under constraints in the special Euclidean group of three dimensions [ SE ( 3 ) ], which requires the quadrotors to leverage a momentary tilted attitude and the asymmetry of the airframes to navigate through gaps. Here, we achieved such maneuvers by developing sensorimotor policies directly mapping onboard vision and proprioception into low-level control commands. The policies were trained using reinforcement learning (RL) with end-to-end policy distillation in simulation. We mitigated the model-free RL’s exploration challenge on the restricted solution space with an initialization strategy leveraging trajectories generated by a model-based planner. Careful sim-to-real design allowed the policy to control a quadrotor through narrow gaps with low clearances and high repeatability. For instance, the proposed method enabled a quadrotor to navigate a rectangular gap at a 5-centimeter clearance, tilted at an orientation up to 90°, without knowledge of the gap’s position or orientation. Without training on dynamic gaps, the policy could reactively servo the quadrotor to traverse through a moving gap. The proposed method was validated on challenging tracks of narrow, closely placed gaps. The flexibility of the policy learning method was demonstrated by developing policies on geometrically diverse gaps without relying on manually defined traversal poses and visual features.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62322314)
- National Natural Science Foundation of China (62203256)
This publication has 50 references indexed in Scilit:
- Learning vision-based agile flight via differentiable physicsNature Machine Intelligence, 2025
- Champion-level drone racing using deep reinforcement learningNature, 2023
- Planning-oriented Autonomous Driving2023
- Searching for MobileNetV32019
- Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation2018
- Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments2016
- Optimization-based locomotion planning, estimation, and control design for the atlas humanoid robotAutonomous Robots, 2015
- Computing Large Convex Regions of Obstacle-Free Space Through Semidefinite Programming2015
- Estimating Uncertain Spatial Relationships in Robotics1990
- Pose estimation from corresponding point dataIEEE Transactions on Systems, Man, and Cybernetics, 1989