Relative Pose Estimation for Light Field Cameras Based on LF-Point-LF-Point Correspondence Model
- 26 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 31 (10577149) , 1641-1656
Abstract
In this paper, we propose a relative pose estimation algorithm for micro-lens array (MLA)-based conventional light field (LF) cameras. First, by employing the matched LF-point pairs, we establish the LF-point-LF-point correspondence model to represent the correlation between LF features of the same 3D scene point in a pair of LFs. Then, we employ the proposed correspondence model to estimate the relative camera pose, which includes a linear solution and a non-linear optimization on manifold. Unlike prior related algorithms, which estimated relative poses based on the recovered depths of scene points, we adopt the estimated disparities to avoid the inaccuracy in recovering depths due to the ultra-small baseline between sub-aperture images of LF cameras. Experimental results on both simulated and real scene data have demonstrated the effectiveness of the proposed algorithm compared with classical as well as state-of-art relative pose estimation algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (62171353, 62101409, 61871325)
- National Key Research and Development Program of China (2018AAA0102803)
This publication has 38 references indexed in Scilit:
- NARROW FIELD-OF-VIEW VISUAL ODOMETRY BASED ON A FOCUSED PLENOPTIC CAMERAISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2015
- Robust Feature Point Matching With Sparse ModelIEEE Transactions on Image Processing, 2014
- Variational Light Field Analysis for Disparity Estimation and Super-ResolutionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Trust-Region Methods on Riemannian ManifoldsFoundations of Computational Mathematics, 2006
- Motion Estimation with Essential and Generalized Essential Matrices2006
- SURF: Speeded Up Robust Features2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Light field rendering1996
- Closed-form solution of absolute orientation using orthonormal matricesJournal of the Optical Society of America A, 1988
- A solution for the best rotation to relate two sets of vectorsActa Crystallographica Section A, 1976