Universal Fingerprint Generation: Controllable Diffusion Model With Multimodal Conditions
- 24 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 47 (2) , 1028-1041
Abstract
The utilization of synthetic data for fingerprint recognition has garnered increased attention due to its potential to alleviate privacy concerns surrounding sensitive biometric data. However, current methods for generating fingerprints have limitations in creating impressions of the same finger with useful intra-class variations. To tackle this challenge, we present GenPrint, a framework to produce fingerprint images of various types while maintaining identity and offering humanly understandable control over different appearance factors, such as fingerprint class, acquisition type, sensor device, and quality level. Unlike previous fingerprint generation approaches, GenPrint is not confined to replicating style characteristics from the training dataset alone: it enables the generation of novel styles from unseen devices without requiring additional fine-tuning. To accomplish these objectives, we developed GenPrint using latent diffusion models with multimodal conditions (text and image) for consistent generation of style and identity. Our experiments leverage a variety of publicly available datasets for training and evaluation. Results demonstrate the benefits of GenPrint in terms of identity preservation, explainable control, and universality of generated images. Importantly, the GenPrint-generated images yield comparable or even superior accuracy to models trained solely on real data and further enhances performance when augmenting the diversity of existing real fingerprint datasets.Keywords
All Related Versions
Funding Information
- George Mason University
This publication has 34 references indexed in Scilit:
- DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation2023
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- A lightweight GAN network for large scale fingerprint generationIEEE Access, 2020
- Towards smartphone-based touchless fingerprint recognitionSādhanā, 2019
- Deep Residual Learning for Image Recognition2016
- Longitudinal study of fingerprint recognitionProceedings of the National Academy of Sciences, 2015
- Multisensor Optical and Latent Fingerprint DatabaseIEEE Access, 2015
- A benchmark 3D fingerprint database2014
- Hierarchical fusion for matching simultaneous latent fingerprint2012
- FVC2004: Third Fingerprint Verification Competition2004