Training and Simulation of Quadrupedal Robot in Adaptive Stair Climbing for Indoor Firefighting: An End-to-End Reinforcement Learning Approach
Preprint
Abstract
Quadruped robots are used for primary searches during the early stages of indoor fires. A typical primary search involves quickly and thoroughly looking for victims under hazardous conditions and monitoring flammable materials. However, situational awareness in complex indoor environments and rapid stair climbing across different staircases remain the main challenges for robot-assisted primary searches. In this project, we designed a two-stage end-to-end deep reinforcement learning (RL) approach to optimize both navigation and locomotion. In the first stage, the quadrupeds, Unitree Go2, were trained to climb stairs in Isaac Lab's pyramid-stair terrain. In the second stage, the quadrupeds were trained to climb various realistic indoor staircases in the Isaac Lab engine, with the learned policy transferred from the previous stage. These indoor staircases are straight, L-shaped, and spiral, to support climbing tasks in complex environments. This project explores how to balance navigation and locomotion and how end-to-end RL methods can enable quadrupeds to adapt to different stair shapes. Our main contributions are: (1) A two-stage end-to-end RL framework that transfers stair-climbing skills from abstract pyramid terrain to realistic indoor stair topologies. (2) A centerline-based navigation formulation that enables unified learning of navigation and locomotion without hierarchical planning. (3) Demonstration of policy generalization across diverse staircases using only local height-map perception. (4) An empirical analysis of success, efficiency, and failure modes under increasing stair difficulty.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Efficient Perception for Indoor Fire Rescue UAVs: A Unified Multimodal Semantic Fusion Framework2025
- Robust Ladder Climbing with a Quadrupedal Robot2025
- High-speed control and navigation for quadrupedal robots on complex and discrete terrainScience Robotics, 2025
- ANYmal parkour: Learning agile navigation for quadrupedal robotsScience Robotics, 2024
- An autonomous ground robot to support firefighters' interventions in indoor emergenciesJournal of Field Robotics, 2023
- Vision-based Dynamic Gait Stair Climbing Algorithm for Quadruped Robot2022
- Novel Mobile Robot Concept for Human Detection in Fire Smoke Indoor Environments using Deep Learning2022
- Perceptive Autonomous Stair Climbing for Quadrupedal Robots2021
- Autonomous Flying into Buildings in a Firefighting Scenario2021
- Learning quadrupedal locomotion over challenging terrainScience Robotics, 2020