Curriculum-Based Reinforcement Learning for Autonomous UAV Navigation in Unknown Curved Tubular Conduit
Authors:
Preprint
Abstract
Autonomous drone navigation in confined tubular environments remains a major challenge due to the constraining geometry of the conduits, the proximity of the walls, and the perceptual limitations inherent to such scenarios. We propose a reinforcement learning approach enabling a drone to navigate unknown three-dimensional tubes without any prior knowledge of their geometry, relying solely on local observations from LiDAR and a conditional visual detection of the tube center. In contrast, the Pure Pursuit algorithm, used as a deterministic baseline, benefits from explicit access to the centerline, creating an information asymmetry designed to assess the ability of RL to compensate for the absence of a geometric model. The agent is trained through a progressive Curriculum Learning strategy that gradually exposes it to increasingly curved geometries, where the tube center frequently disappears from the visual field. A turning-negotiation mechanism, based on the combination of direct visibility, directional memory, and LiDAR symmetry cues, proves essential for ensuring stable navigation under such partial observability conditions. Experiments show that the PPO policy acquires robust and generalizable behavior, consistently outperforming the deterministic controller despite its limited access to geometric information. Validation in a high-fidelity 3D environment further confirms the transferability of the learned behavior to a continuous physical dynamics. The proposed approach thus provides a complete framework for autonomous navigation in unknown tubular environments and opens perspectives for industrial, underground, or medical applications where progressing through narrow and weakly perceptive conduits represents a central challenge.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- A Survey on LiDAR-Based Autonomous Aerial VehiclesIEEE/ASME Transactions on Mechatronics, 2025
- Safe navigation for robotic digestive endoscopy via human intervention-based reinforcement learningExpert Systems with Applications, 2025
- Constrained Reinforcement Learning and Formal Verification for Safe Colonoscopy Navigation2023
- Colonoscopy Navigation using End-to-End Deep Visuomotor Control: A User Study2022
- A method for autonomous collision-free navigation of a quadrotor UAV in unknown tunnel-like environmentsRobotica, 2021
- LION: Lidar-Inertial Observability-Aware Navigator for Vision-Denied Environments2021
- Vision-based MAV Navigation in Underground Mine Using Convolutional Neural Network2019