Semi-direct visual odometry for a fisheye-stereo camera
Authors:
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4077-4084
Abstract
We present a semi-direct visual odometry algorithm for a fisheye-stereo camera. In a tracking thread, we simultaneously track oriented patches and estimate the camera pose. In a mapping thread, we estimate the coordinates and surface normal for each new patch to be tracked. Estimation of the surface normals allows us to track patches over a wide variety of viewpoints. In our algorithm, we do not make use of descriptors and robust descriptor matching to find patch correspondences. Instead, we use photoconsistency-based techniques to find patch correspondences. For tracking, we use sparse model-based image alignment to find the relative motion estimate, and feature alignment to find 2D-3D patch correspondences. For mapping, we use plane-sweeping stereo to find matching patches between stereo images. We also implement a state estimator based on the Extended Kalman Filter (EKF) to fuse inertial measurements and relative pose estimates from our visual odometry implementation. We run experiments in two different outdoor environments to validate our algorithm, and discuss the experimental results. Our implementation runs at an average of 42 Hz on a commodity Intel CPU. To the best of our knowledge, there is no other existing semi-direct visual odometry algorithm for a fisheye-stereo camera.Keywords
This publication has 16 references indexed in Scilit:
- Large-scale direct SLAM with stereo cameras2015
- Robust visual inertial odometry using a direct EKF-based approach2015
- Large-scale direct SLAM for omnidirectional cameras2015
- Dense visual-inertial navigation system for mobile robots2015
- A robust and modular multi-sensor fusion approach applied to MAV navigation2013
- Vision-Based State Estimation and Trajectory Control Towards High-Speed Flight with a Quadrotor2013
- Robust odometry estimation for RGB-D cameras2013
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- Visual Odometry [Tutorial]IEEE Robotics & Automation Magazine, 2011
- DTAM: Dense tracking and mapping in real-time2011