Gradient-Based Feature Extraction From Raw Bayer Pattern Images
- 20 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 30 (10577149) , 5122-5137
Abstract
In this paper, the impact of demosaicing on gradient extraction is studied and a gradient-based feature extraction pipeline based on raw Bayer pattern images is proposed. It is shown both theoretically and experimentally that the Bayer pattern images are applicable to the central difference gradient-based feature extraction algorithms with negligible performance degradation, as long as the arrangement of color filter array (CFA) patterns matches the gradient operators. The color difference constancy assumption, which is widely used in various demosaicing algorithms, is applied in the proposed Bayer pattern image-based gradient extraction pipeline. Experimental results show that the gradients extracted from Bayer pattern images are robust enough to be used in histogram of oriented gradients (HOG)-based pedestrian detection algorithms and shift-invariant feature transform (SIFT)-based matching algorithms. By skipping most of the steps in the image signal processing (ISP) pipeline, the computational complexity and power consumption of a computer vision system can be reduced significantly.Keywords
All Related Versions
Funding Information
- Natural Science Foundation of China (61801292)
- Shanghai Sailing Program (18YF1416600)
This publication has 37 references indexed in Scilit:
- CFA local binary patterns for fast illuminant-invariant color texture classificationJournal of Real-Time Image Processing, 2012
- Comparison of Color Demosaicing Methods2010
- ASIFT: A New Framework for Fully Affine Invariant Image ComparisonSIAM Journal on Imaging Sciences, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Color filter array demosaicking: New method and performance measuresIEEE Transactions on Image Processing, 2003
- Color plane interpolation using alternating projectionsIEEE Transactions on Image Processing, 2002
- Demosaicking methods for Bayer color arraysJournal of Electronic Imaging, 2002
- Demosaicing: image reconstruction from color CCD samplesIEEE Transactions on Image Processing, 1999
- Information measures in scale-spacesIEEE Transactions on Information Theory, 1999