Real-time depth enhanced monocular odometry
- 1 September 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 4973-4980
Abstract
Visual odometry can be augmented by depth information such as provided by RGB-D cameras, or from lidars associated with cameras. However, such depth information can be limited by the sensors, leaving large areas in the visual images where depth is unavailable. Here, we propose a method to utilize the depth, even if sparsely available, in recovery of camera motion. In addition, the method utilizes depth by triangulation from the previously estimated motion, and salient visual features for which depth is unavailable. The core of our method is a bundle adjustment that refines the motion estimates in parallel by processing a sequence of images, in a batch optimization. We have evaluated our method in three sensor setups, one using an RGB-D camera, and two using combinations of a camera and a 3D lidar. Our method is rated #2 on the KITTI odometry benchmark irrespective of sensing modality, and is rated #1 among visual odometry methods.Keywords
This publication has 26 references indexed in Scilit:
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- DENSE TRACKING AND MAPPING WITH A QUADROCOPTERThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2013
- Monocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A CompendiumJournal of Field Robotics, 2013
- Robust odometry estimation for RGB-D cameras2013
- Robust real-time visual odometry for dense RGB-D mapping2013
- RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environmentsThe International Journal of Robotics Research, 2012
- iSAM2: Incremental smoothing and mapping using the Bayes treeThe International Journal of Robotics Research, 2011
- 1-Point-RANSAC Structure from Motion for Vehicle-Mounted Cameras by Exploiting Non-holonomic ConstraintsInternational Journal of Computer Vision, 2011
- Two years of Visual Odometry on the Mars Exploration RoversJournal of Field Robotics, 2007
- Visual odometry for ground vehicle applicationsJournal of Field Robotics, 2006