Revelio: A Modular and Effective Framework for Reproducible Training and Evaluation of Morphing Attack Detectors
Open Access
- 27 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 120419-120437
Abstract
Morphing Attack, i.e. the elusion of face verification systems through a facial morphing operation between a criminal and an accomplice, has recently emerged as a serious security threat. Despite the importance of this kind of attack, the development and comparison of Morphing Attack Detection (MAD) methods is still a challenging task, especially with deep learning approaches. Specifically, the lack of public datasets, the absence of common training and validation protocols, and the limited release of public source code hamper the reproducibility and objective comparison of new MAD systems. Usually, these aspects are mainly due to privacy concerns, that limit data transfers and storage, and to the recent introduction of the MAD task. Therefore, in this paper, we propose and publicly release Revelio , a modular framework for the reproducible development and evaluation of MAD systems. We include an overview of the modules, and describe the plugin system providing the possibility of extending native components with new functionalities. An extensive cross-datasets experimental evaluation is conducted to validate the framework and the performance of trained models on several publicly-released datasets, and to deeply analyze the main challenges in the MAD task based on single input images. We also propose a new metric, namely WAED, to summarize in a single value the error-based metrics commonly used in the MAD task, computed over different datasets, thus facilitating the comparative evaluation of different approaches. Finally, by exploiting Revelio, a new state-of-the-art MAD model (on SOTAMD single-image benchmark) is proposed and released.Keywords
Funding Information
- European Union’s Horizon 2020 Research and Innovation Program (883356)
This publication has 40 references indexed in Scilit:
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Deep Residual Learning for Image Recognition2016
- Going deeper with convolutions2015
- The Chicago face database: A free stimulus set of faces and norming dataBehavior Research Methods, 2015
- The magic passport2014
- Fingerprint and On-Line Signature Verification Competitions at ICB 20092009
- Overview of the Face Recognition Grand Challenge2005
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004
- An introduction to waveletsIEEE Computational Science and Engineering, 1995