A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor
- 6 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 30 (10577149) , 4171-4182
Abstract
The emergence of the single-chip polarized color sensor now allows for simultaneously capturing chromatic and polarimetric information of the scene on a monochromatic image plane. However, unlike the usual camera with an embedded demosaicing method, the latest polarized color camera is not delivered with an in-built demosaicing tool. For demosaicing, the users have to down-sample the captured images or to use traditional interpolation techniques. Neither of them can perform well since the polarization and color are interdependent. Therefore, joint chromatic and polarimetric demosaicing is the key to obtaining high-quality polarized color images. In this paper, we propose a joint chromatic and polarimetric demosaicing model to address this challenging problem. Instead of mechanically demosaicing for the multi-channel polarized color image, we further present a sparse representation-based optimization strategy that utilizes chromatic information and polarimetric information to jointly optimize the model. To avoid the interaction between color and polarization during demosaicing, we separately construct the corresponding dictionaries. We also build an optical data acquisition system to collect a dataset, which contains various sources of polarization, such as illumination, reflectance and birefringence. Results of both qualitative and quantitative experiments have shown that our method is capable of faithfully recovering full RGB information of four polarization angles for each pixel from a single mosaic input image. Moreover, the proposed method can perform well not only on the synthetic data but the real captured data.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61732016)
This publication has 52 references indexed in Scilit:
- Color image demosaicking: An overviewSignal Processing: Image Communication, 2011
- Zhang-Wu Directional LMMSE Image DemosaickingImage Processing On Line, 2011
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- Color demosaicking by local directional interpolation and nonlocal adaptive thresholdingJournal of Electronic Imaging, 2011
- Interpolation strategies for reducing IFOV artifacts in microgrid polarimeter imageryOptics Express, 2009
- Polarisation-analysing CMOS photosensor with monolithically embedded wire grid polariserElectronics Letters, 2009
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse RepresentationIEEE Transactions on Signal Processing, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Interpolation using neural networks for digital still camerasIEEE Transactions on Consumer Electronics, 2000
- Principal Components in Regression Analysis1986