A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation
- 15 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Imaging
- Vol. 10 (25730436) , 1400-1413
Abstract
Emerging monochrome and chromatic polarization filter array (MPFA and CPFA) cameras require polarization demosaicking to obtain accurate polarization parameters. Polarization cameras sample the polarization intensity at each location of the pixels. A captured raw image must be converted to a full-channel polarization intensity image using the polarization demosaicking method (PDM). However, due to sparse sampling between polarization channels, implementing MPFA and CPFA demosaicking has been challenging. This paper proposes a new hybrid polarization demosaicking algorithm that leverages polarization confidence-based refinement to exploit inter-channel polarization correlation. Additionally, we enhance texture correlation to utilize inter-channel texture correlation fully. Our three-stage PDM preserves both the polarization and texture information. We also introduce a metric computation method to handle the $\pi$ -ambiguity of the angle of line polarization (AoLP). This approach mitigates inaccuracies and $\pi$ -ambiguity in existing methods when describing the quality of AoLP reconstruction. We extensively compare and conduct ablation experiments on synthetic datasets from MPFA and CPFA. Our method achieves competitive results compared to other state-of-the-art methods. Furthermore, we evaluate our proposal on real-world datasets to demonstrate its applicability in real-world, variable scenarios. Two application experiments (road detection and shape from polarization) show that our proposal can be applied to real-world applications.Keywords
Funding Information
- National Natural Science Foundation of China (U2013210, 62105372)
- LiaoNing Science Fund for Distinguished Young Scholars (2023JH6/100500005)
This publication has 66 references indexed in Scilit:
- Underwater descattering with polarization line constraintOptics and Lasers in Engineering, 2024
- Polarization image demosaicking based on homogeneity spaceOptics and Lasers in Engineering, 2024
- Sparse representation-based demosaicking method for joint chromatic and polarimetric imageryOptics and Lasers in Engineering, 2023
- Illumination-invariant road detection and tracking using LWIR polarization characteristicsISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Polarimetric Normal Stereo2021
- Full-Time Monocular Road Detection Using Zero-Distribution Prior of Angle of Polarization2020
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Deep Residual Learning for Image Recognition2016
- Compressive sensing multi-spectral demosaicing from single sensor architecture2014
- Polarisation-analysing CMOS photosensor with monolithically embedded wire grid polariserElectronics Letters, 2009