DeepAirSig: End-to-End Deep Learning Based in-Air Signature Verification
Open Access
- 26 October 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 195832-195843
Abstract
In-air signature verification is vital for biometric user identification in contact-less mode. The state-of-the-art methods use heuristics for signature acquisition, and provide insufficient data to train neural networks for the verification. In this article, we present a novel method for end-to-end deep learning based in-air signature verification using a depth sensor. In this regard, we propose a new medium-scale in-air signature dataset which is created using an accurate convolutional neural network (CNN) based 3D hand pose estimation algorithm. The proposed dataset offers a total of 1800 signatures collected from 40 subjects. So far, dynamic time warping (DTW) has been the most effective and commonly used method for verification. Keeping in view the significant advancement in deep learning, we present a more accurate deep learning based alternative which outperforms DTW by 67.6%. To this end, we train a personalized autoencoder to reconstruct the signature of each subject. Thereafter, the signature is verified by thresholding the reconstruction loss. We perform extensive experiments by formulating spatial and depth features of the signature in images and point clouds based representations. Moreover, for comparisons, we implement several deep learning algorithms (i.e. linear autoencoder, convolutional autoencoder, and Deep One-Class classifier). Our verification approach achieves an EER of 0.055%. The dataset is available at https://bit.ly/2mEJzOw .Keywords
Funding Information
- Federal Ministry of Education and Research of the Federal Republic of Germany as part of the research projects VIDETE (01IW18002)
- DAAD Project MEAACA (57459097)
This publication has 39 references indexed in Scilit:
- Online signature verification based on feature representation2015
- Deep learning in neural networks: An overviewNeural Networks, 2015
- SigVer3D: Accelerometer Based Verification of 3-D Signatures on Mobile Devices2015
- SIMILARITY EVALUATION OF ONLINE SIGNATURES BASED ON MODIFIED DYNAMIC TIME WARPINGApplied Artificial Intelligence, 2013
- Offline Signature Verification Using Pixel Matching TechniqueProcedia Technology, 2013
- Analysis of pattern recognition techniques for in-air signature biometricsPattern Recognition, 2011
- Combining different biometric traits with one-class classificationSignal Processing, 2009
- One-class document classification via Neural NetworksNeurocomputing, 2007
- Online signature verification using a new extreme points warping techniquePattern Recognition Letters, 2003
- Reliable online human signature verification systemsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996