Structure-From-Motion in Spherical Video Using the von Mises-Fisher Distribution
- 26 October 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 26 (2) , 711-723
Abstract
In this paper, we present a complete pipeline for computing structure-from-motion from the sequences of spherical images. We revisit problems from multiview geometry in the context of spherical images. In particular, we propose methods suited to spherical camera geometry for the spherical-n-point problem (estimating camera pose for a spherical image) and calibrated spherical reconstruction (estimating the position of a 3-D point from multiple spherical images). We introduce a new probabilistic interpretation of spherical structure-from-motion which uses the von Mises-Fisher distribution to model noise in spherical feature point positions. This model provides an alternate objective function that we use in bundle adjustment. We evaluate our methods quantitatively and qualitatively on both synthetic and real world data and show that our methods developed for spherical images outperform straightforward adaptations of methods developed for perspective images. As an application of our method, we use the structure-from-motion output to stabilise the viewing direction in fully spherical video.Keywords
This publication has 27 references indexed in Scilit:
- SPHERA - A Unifying Structure from Motion Framework for Central Projection Cameras2015
- SPHORB: A Fast and Robust Binary Feature on the SphereInternational Journal of Computer Vision, 2014
- Interactive Cinema: Engagement and Interaction2014
- Outdoor human motion capture using inverse kinematics and von mises-fisher sampling2011
- From Google Street View to 3D city models2009
- Monocular visual odometry in urban environments using an omnidirectional camera2008
- Graph Implementations for Nonsmooth Convex Programs2007
- Re-cinematography2007
- A Generic Concept for Camera Calibration2004
- Simulation of the von mises fisher distributionCommunications in Statistics - Simulation and Computation, 1994