Open-Set Learning-Based Hologram Verification System Using Generative Adversarial Networks
Author:
Open Access
- 2 March 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 25114-25124
Abstract
In this study, we address the hologram authenticity challenge by introducing a novel deep-learning based end-to-end hologram verification system. The system ultimately makes the decision whether the hologram image captured from a mobile application is fake or not by employing a robust classifier. We built the system by training three major deep networks; generative networks, convolutional networks and region-based convolutional networks. One major challenge in this study was the lack of negative class samples or so-called fake holograms. To the best of our knowledge there are no publicly available fake hologram datasets and it is not clear how the attackers imitate the real holograms. Therefore, the negative class in the practical hologram classification task is actually “unknown” class, as it is unknown how to imitate holograms by attackers. We hereby consider the problem of hologram classification as in a similar logic to open-set recognition. To make hologram classifier more sensitive to forgery, we generate synthetic images using generative adversarial networks (GANs) to represent negative class. We conduct extensive and comparative experiments on the closed-set and open-set using the-state-of-the-art backbone convolutional neural networks (CNNs). The proposed system gives an impressive accuracy 97.5% and 79% for closed-set and open-set samples, respectively. The reported results show the strong generalization performance of the system for unknown samples.Keywords
Funding Information
- Computing Resources at the Big Data and Artificial Intelligence Laboratory, Firat University
This publication has 26 references indexed in Scilit:
- Mobile hologram verification with deep learningIPSJ Transactions on Computer Vision and Applications, 2017
- Image-based approach for the detection of counterfeit banknotes of Bangladesh2016
- Perceptual Losses for Real-Time Style Transfer and Super-Resolution2016
- Banknote Counterfeit Detection through Background Texture Printing Analysis2016
- Towards Mobile Recognition and Verification of Holograms Using Orthogonal Sampling2015
- Open Set Fingerprint Spoof Detection Across Novel Fabrication MaterialsIEEE Transactions on Information Forensics and Security, 2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- AR-Based Hologram Detection on Security Documents Using a Mobile Phone2014
- An automatic inspection system for hologram with multiple patterns2007
- A Wiener filter based correlation method intended to evaluate effectiveness of holographic security devicesOptics Communications, 2003