Songze He
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Songze He has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Chang Liu
School of Artificial Intelligence, Beijing Normal University, Beijing, China
1 shared publication - Jia Li
Beijing Normal University
1 shared publication - Jiajun Xu
Department of Biosystems & Agricultural Engineering, Michigan State University, East Lansing, MI 48824, United States of America
1 shared publication
Latest Publications
- 27 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 31 (10709908) , 989-993
Fine-Tuning for Bayer Demosaicking Through Periodic-Consistent Self-Supervised Learning
Deep learning-based Bayer demosaicking methods have achieved superior performance. They require a large amount of paired images, which are challenging to collect. So most of these methods resort to using simulated images, where the raw images are sampled from the RGB images with the Bayer color filter array (CFA). However, there is a domain gap between simulated images and real images, which makes the learned networks less practical in the real world. To address this problem, we propose a simple and effective self-supervised learning framework for Bayer demosaicking. We observe that the Bayer CFA is periodic, and its four equivalent patterns can be transformed into each other through simple translation. Accordingly, we propose the concept of periodic-consistent demosaicking, which means that a demosaicking network should produce an identical demosaicked image for the same scene captured by the four equivalent patterns. Our framework can fine-tune existing demosaicking networks using only single raw images. We demonstrate the effectiveness of our framework on both clean and noisy images. Source code will be released.
- 27 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 31 (10709908) , 989-993
Fine-Tuning for Bayer Demosaicking Through Periodic-Consistent Self-Supervised Learning
Deep learning-based Bayer demosaicking methods have achieved superior performance. They require a large amount of paired images, which are challenging to collect. So most of these methods resort to using simulated images, where the raw images are sampled from the RGB images with the Bayer color filter array (CFA). However, there is a domain gap between simulated images and real images, which makes the learned networks less practical in the real world. To address this problem, we propose a simple and effective self-supervised learning framework for Bayer demosaicking. We observe that the Bayer CFA is periodic, and its four equivalent patterns can be transformed into each other through simple translation. Accordingly, we propose the concept of periodic-consistent demosaicking, which means that a demosaicking network should produce an identical demosaicked image for the same scene captured by the four equivalent patterns. Our framework can fine-tune existing demosaicking networks using only single raw images. We demonstrate the effectiveness of our framework on both clean and noisy images. Source code will be released.