Fingerphoto Deblurring Using Attention-Guided Multi-Stage GAN
Open Access
- 2 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 82709-82727
Abstract
Using fingerphoto images acquired from mobile cameras, low-quality sensors, or crime scenes, it has become a challenge for automated identification systems to verify the identity due to various acquisition distortions. A significant type of photometric distortion that notably reduces the quality of a fingerphoto is the blurring of the image. This paper proposes a deep fingerphoto deblurring model to restore the ridge information degraded by the image blurring. As the core of our model, we utilize a conditional Generative Adversarial Network (cGAN) to learn the distribution of natural ridge patterns. We perform several modifications to enhance the quality of the reconstructed (deblurred) fingerphotos by our proposed model. First, we develop a multi-stage GAN to learn the ridge distribution in a coarse-to-fine framework. This framework enables the model to maintain the consistency of the ridge deblurring process at different resolutions. Second, we propose a guided attention module that helps the generator to focus mainly on blurred regions. Third, we incorporate a deep fingerphoto verifier as an auxiliary adaptive loss function to force the generator to preserve the ID information during the deblurring process. Finally, we evaluate the effectiveness of the proposed model through extensive experiments on multiple public fingerphoto datasets as well as real-world blurred fingerphotos. In particular, our method achieves 5.2 dB, 8.7%, and 7.6% improvement in PSNR, AUC, and EER, respectively, compared to a state-of-the-art deblurring method.Keywords
Funding Information
- Center for Identification Technology Research and the National Science Foundation (1650474)
This publication has 84 references indexed in Scilit:
- A touch-less fingerphoto recognition system for mobile hand-held devices2015
- Efficient blind image deblurring method for palm print images2015
- Kernel estimation from salient structure for robust motion deblurringSignal Processing: Image Communication, 2013
- Multi-image Blind Deblurring Using a Coupled Adaptive Sparse Prior2013
- Towards Contactless, Low-Cost and Accurate 3D Fingerprint Identification2013
- Contactless fingerprint recognition: A neural approach for perspective and rotation effects reduction2013
- Two-Phase Kernel Estimation for Robust Motion Deblurring2010
- Preprocessing of a Fingerprint Image Captured with a Mobile CameraLecture Notes in Computer Science, 2005
- Fingerprint image enhancement: algorithm and performance evaluationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Detection of singular points in fingerprint imagesPattern Recognition, 1992