Joint Registration and Super-Resolution With Omnidirectional Images
Authors:
- 25 April 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 20 (11) , 3151-3162
Abstract
This paper addresses the reconstruction of high-resolution omnidirectional images from multiple low-resolution images with inexact registration. When omnidirectional images from low-resolution vision sensors can be uniquely mapped on the 2-sphere, such a reconstruction can be described as a transform-domain super-resolution problem in a spherical imaging framework. We describe how several spherical images with arbitrary rotations in the SO(3) rotation group contribute to the reconstruction of a high-resolution image with help of the spherical Fourier transform (SFT). As low-resolution images might not be perfectly registered in practice, the impact of inaccurate alignment on the transform coefficients is analyzed. We then cast the joint registration and super-resolution problem as a total least-squares norm minimization problem in the SFT domain. A l1-regularized total least-squares problem is considered and solved efficiently by interior point methods. Experiments with synthetic and natural images show that the proposed methods lead to effective reconstruction of high-resolution images even when large registration errors exist in the low-resolution images. The quality of the reconstructed images also increases rapidly with the number of low-resolution images, which demonstrates the benefits of the proposed solution in super-resolution schemes. Finally, we highlight the benefit of the additional regularization constraint that clearly leads to reduced noise and improved reconstruction quality.Keywords
This publication has 29 references indexed in Scilit:
- An Interior-Point Method for Large-Scale -Regularized Least SquaresIEEE Journal of Selected Topics in Signal Processing, 2007
- Rotation recovery from spherical images without correspondencesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Super-resolution omnidirectional camera images using spatio-temporal analysisElectronics and Communications in Japan (Part III: Fundamental Electronic Science), 2006
- Estimating alignment errors in sets of 2-D imagesJournal of Structural Biology, 2005
- Super-resolution spherical microphone arrays2004
- Efficiency of 2D alignment methodsUltramicroscopy, 2002
- EMAN: Semiautomated Software for High-Resolution Single-Particle ReconstructionsJournal of Structural Biology, 1999
- The correlation averaging of a regularly arranged bacterial cell envelope proteinJournal of Microscopy, 1982
- Detection of objects in quantum-noise-limited imagesUltramicroscopy, 1982
- An Algorithm for Least-Squares Estimation of Nonlinear ParametersJournal of the Society for Industrial and Applied Mathematics, 1963