Real-time motion tracking on a cellphone using inertial sensing and a rolling-shutter camera
Authors:
- 1 May 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 4712-4719
Abstract
All existing methods for vision-aided inertial navigation assume a camera with a global shutter, in which all the pixels in an image are captured simultaneously. However, the vast majority of consumer-grade cameras use rolling-shutter sensors, which capture each row of pixels at a slightly different time instant. The effects of the rolling shutter distortion when a camera is in motion can be very significant, and are not modelled by existing visual-inertial motion-tracking methods. In this paper we describe the first, to the best of our knowledge, method for vision-aided inertial navigation using rolling-shutter cameras. Specifically, we present an extended Kalman filter (EKF)-based method for visual-inertial odometry, which fuses the IMU measurements with observations of visual feature tracks provided by the camera. The key contribution of this work is a computationally tractable approach for taking into account the rolling-shutter effect, incurring only minimal approximations. The experimental results from the application of the method show that it is able to track, in real time, the position of a mobile phone moving in an unknown environment with an error accumulation of approximately 0.8% of the distance travelled, over hundreds of meters.Keywords
This publication has 20 references indexed in Scilit:
- High-precision, consistent EKF-based visual-inertial odometryThe International Journal of Robotics Research, 2013
- Vision-aided inertial navigation for resource-constrained systems2012
- Probabilistic 3-D motion estimation for rolling shutter video rectification from visual and inertial measurements2012
- Rolling shutter bundle adjustment2012
- Stabilizing cell phone video using inertial measurement sensors2011
- Structure and motion estimation from rolling shutter video2011
- Rectifying rolling shutter video from hand-held devices2010
- Parallel Tracking and Mapping on a camera phone2009
- Structure and kinematics triangulation with a rolling shutter stereo rig2009
- Parallel Tracking and Mapping for Small AR Workspaces2007