Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments
Authors:
- Stephan WeissSWStephan Weiss
- Markus W. AchtelikMAMarkus W. Achtelik
- Simon LynenSLSimon Lynen
- Margarita ChliMCMargarita Chli
- Roland SiegwartRSRoland Siegwart
Top Cited Papers
- 1 May 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 957-964
Abstract
The combination of visual and inertial sensors has proved to be very popular in robot navigation and, in particular, Micro Aerial Vehicle (MAV) navigation due the flexibility in weight, power consumption and low cost it offers. At the same time, coping with the big latency between inertial and visual measurements and processing images in real-time impose great research challenges. Most modern MAV navigation systems avoid to explicitly tackle this by employing a ground station for off-board processing. In this paper, we propose a navigation algorithm for MAVs equipped with a single camera and an Inertial Measurement Unit (IMU) which is able to run onboard and in real-time. The main focus here is on the proposed speed-estimation module which converts the camera into a metric body-speed sensor using IMU data within an EKF framework. We show how this module can be used for full self-calibration of the sensor suite in real-time. The module is then used both during initialization and as a fall-back solution at tracking failures of a keyframe-based VSLAM module. The latter is based on an existing high-performance algorithm, extended such that it achieves scalable 6DoF pose estimation at constant complexity. Fast onboard speed control is ensured by sole reliance on the optical flow of at least two features in two consecutive camera frames and the corresponding IMU readings. Our nonlinear observability analysis and our real experiments demonstrate that this approach can be used to control a MAV in speed, while we also show results of operation at 40Hz on an onboard Atom computer 1.6 GHz.Keywords
This publication has 10 references indexed in Scilit:
- Real-time metric state estimation for modular vision-inertial systems2011
- Autonomous multi-floor indoor navigation with a computationally constrained MAV2011
- State Estimation Based on the Concept of Continuous Symmetry and Observability Analysis: The Case of CalibrationIEEE Transactions on Robotics, 2011
- Estimating Ego-Motion in Panoramic Image Sequences with Inertial Measurements2011
- Bayesian Visual OdometryAIP Conference Proceedings, 2011
- Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibrationThe International Journal of Robotics Research, 2010
- A terrain-following control approach for a VTOL Unmanned Aerial Vehicle using average optical flowAutonomous Robots, 2010
- A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance EvaluationIEEE Transactions on Robotics, 2008
- MonoSLAM: Real-Time Single Camera SLAMIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Improving vision-based control using efficient second-order minimization techniques2004