Scale-Aware Monocular Visual Odometry and Extrinsic Calibration Using Vehicle Kinematics
- 11 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (12) , 14757-14771
Abstract
This paper proposes a new approach to scale-aware monocular visual odometry (VO) and extrinsic calibration using constraints on camera motion by vehicle kinematics. Main idea is to utilize the Ackermann steering model to observe absolute metric scale in turning motion. To describe motion of the camera attached to the vehicle, we first estimate unknown camera-vehicle relative pose by the proposed extrinsic calibration method. To stably observe scale, we detect turn regions and design an observer to estimate the absolute scale as a function of the camera rotation and direction of translational motion during turning. Using the observed scale, we propose an absolute scale recovery to estimate the unknown scale between turns. Because the proposed scale observer becomes singular near zero rotation, we conduct sensitivity analysis on the scale observer, and investigate appropriate conditions for stable scale estimation. For quantitative evaluation of the extrinsic calibration and the absolute scale recovery, we randomly generate synthetic driving datasets with various noise conditions, and evaluate the performance of each module statistically by Monte-Carlo simulations. To evaluate the overall performance, we implement our method and state-of-the-art monocular and stereo VO methods in the public outdoor driving KITTI dataset, and our method shows competitive scale recovery performance with no external sensor and no assumption on surroundings such as planar ground landmarks. To show promising applicability, we collect real-world driving datasets in two multi-floor underground parking lots, and demonstrate the accurate absolute scale recovery performance of our method in indoor driving situations.Keywords
Funding Information
- Unmanned Vehicles Core Technology Research and Development Program through the National Research Foundation of Korea
- Unmanned Vehicle Advanced Research Center
- Ministry of Science and Information and Communication Technology (ICT), Republic of Korea (NRF-2020M3C1C1A010864)
This publication has 38 references indexed in Scilit:
- ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D CamerasIEEE Transactions on Robotics, 2017
- Multimodal scale estimation for monocular visual odometry2017
- DeepVO: Towards end-to-end visual odometry with deep Recurrent Convolutional Neural Networks2017
- Direct Sparse OdometryIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- High Accuracy Monocular SFM and Scale Correction for Autonomous DrivingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- LOAM: Lidar Odometry and Mapping in Real-time2014
- Visual Odometry [Tutorial]IEEE Robotics & Automation Magazine, 2011
- 1-Point-RANSAC Structure from Motion for Vehicle-Mounted Cameras by Exploiting Non-holonomic ConstraintsInternational Journal of Computer Vision, 2011
- Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAMJournal of Intelligent & Robotic Systems, 2010