A Spatial-Frequency Domain Associated Image-Optimization Method for Illumination-Robust Image Matching
Open Access
Abstract
Image matching forms an essential means of data association for computer vision, photogrammetry and remote sensing. The quality of image matching is heavily dependent on image details and naturalness. However, complex illuminations, denoting extreme and changing illuminations, are inevitable in real scenarios, and seriously deteriorate image matching performance due to their significant influence on the image naturalness and details. In this paper, a spatial-frequency domain associated image-optimization method, comprising two main models, is specially designed for improving image matching with complex illuminations. First, an adaptive luminance equalization is implemented in the spatial domain to reduce radiometric variations, instead of removing all illumination components. Second, a frequency domain analysis-based feature-enhancement model is proposed to enhance image features while preserving image naturalness and restraining over-enhancement. The proposed method associates the advantages of the spatial and frequency domain analyses to complete illumination equalization, feature enhancement and naturalness preservation, and thus acquiring the optimized images that are robust to the complex illuminations. More importantly, our method is generic and can be embedded in most image-matching schemes to improve image matching. The proposed method was evaluated on two different datasets and compared with four other state-of-the-art methods. The experimental results indicate that the proposed method outperforms other methods under complex illuminations, in both matching performances and practical applications such as structure from motion and multi-view stereo.Keywords
Funding Information
- National Major Science and Technology Projects of China (2016YFB0502102)
This publication has 56 references indexed in Scilit:
- The Perception of Naturalness Correlates with Low-Level Visual Features of Environmental ScenesPLOS ONE, 2014
- A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differencesISPRS Journal of Photogrammetry and Remote Sensing, 2014
- An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistencyJournal of Visual Communication and Image Representation, 2013
- Robust line matching through line–point invariantsPattern Recognition, 2012
- On the Use of Low-Pass Filters for Image Processing with Inverse Laplacian ModelsJournal of Mathematical Imaging and Vision, 2011
- ASIFT: A New Framework for Fully Affine Invariant Image ComparisonSIAM Journal on Imaging Sciences, 2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Color reproduction and the naturalness constraintColor Research & Application, 1999
- Practical considerations on color image enhancement using homomorphic filteringJournal of Electronic Imaging, 1997