Visual-Inertial and Leg Odometry Fusion for Dynamic Locomotion
Authors:
Preprint
Abstract
Implementing dynamic locomotion behaviors on legged robots requires a high-quality state estimation module. Especially when the motion includes flight phases, state-of-the-art approaches fail to produce reliable estimation of the robot posture, in particular base height. In this paper, we propose a novel approach for combining visual-inertial odometry (VIO) with leg odometry in an extended Kalman filter (EKF) based state estimator. The VIO module uses a stereo camera and IMU to yield low-drift 3D position and yaw orientation and drift-free pitch and roll orientation of the robot base link in the inertial frame. However, these values have a considerable amount of latency due to image processing and optimization, while the rate of update is quite low which is not suitable for low-level control. To reduce the latency, we predict the VIO state estimate at the rate of the IMU measurements of the VIO sensor. The EKF module uses the base pose and linear velocity predicted by VIO, fuses them further with a second high-rate IMU and leg odometry measurements, and produces robot state estimates with a high frequency and small latency suitable for control. We integrate this lightweight estimation framework with a nonlinear model predictive controller and show successful implementation of a set of agile locomotion behaviors, including trotting and jumping at varying horizontal speeds, on a torque-controlled quadruped robot.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- BiConMP: A Nonlinear Model Predictive Control Framework for Whole Body Motion PlanningIEEE Transactions on Robotics, 2023
- VILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged RobotsIEEE Transactions on Robotics, 2022
- STEP: State Estimator for Legged Robots Using a Preintegrated Foot Velocity FactorIEEE Robotics and Automation Letters, 2022
- Legged Robot State Estimation With Dynamic Contact Event InformationIEEE Robotics and Automation Letters, 2021
- Pronto: A Multi-Sensor State Estimator for Legged Robots in Real-World ScenariosFrontiers in Robotics and AI, 2020
- An Open Torque-Controlled Modular Robot Architecture for Legged Locomotion ResearchIEEE Robotics and Automation Letters, 2020
- Contact-aided invariant extended Kalman filtering for robot state estimationThe International Journal of Robotics Research, 2020
- Visual-Inertial Mapping With Non-Linear Factor RecoveryIEEE Robotics and Automation Letters, 2019
- Robust Legged Robot State Estimation Using Factor Graph OptimizationIEEE Robotics and Automation Letters, 2019
- A Tutorial on Quantitative Trajectory Evaluation for Visual(-Inertial) Odometry2018