Multi-Channel Remote Photoplethysmography Correspondence Feature for 3D Mask Face Presentation Attack Detection
- 8 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 16 (15566013) , 2683-2696
Abstract
With the advancement of 3D printing technologies, 3D mask presentation attack becomes a critical challenge in face recognition. To tackle the 3D mask presentation attack detection (PAD), remote Photoplethysmography (rPPG) is employed as an intrinsic detection cue which is independent of the mask material and appearance quality. Although the effectiveness of existing rPPG-based methods has been verified, they may not be robust enough when rPPG signals are contaminated by noise. To identify the heartbeat information from the noisy raw rPPG signals, we propose a new 3D mask PAD feature, multi-channel rPPG correspondence feature (MCCFrPPG) with the global noise-aware template learning and verification framework. To further boost the discriminability, temporal variation of the rPPG signal is considered and extracted through the multi-channel time-frequency analysis scheme. This paper also extends HKBU-MARs V2 dataset with more customized high-quality masks and increases the number of videos by two times. Comprehensive experiments were performed on existing 3D mask datasets and the extended HKBU-MARs V2+, which totally covers 3 types of masks, 12 different light settings and 6 cameras. The results not only justify the effectiveness and robustness of the proposed MCCFrPPG on 3D mask attacks but also indicate its potential on handling the replay attack with camera motion and dim light.Keywords
Funding Information
- Hong Kong Research Grant Council (GRF RGC/HKBU12200820)
This publication has 39 references indexed in Scilit:
- DistancePPG: Robust non-contact vital signs monitoring using a cameraBiomedical Optics Express, 2015
- Face Spoof Detection With Image Distortion AnalysisIEEE Transactions on Information Forensics and Security, 2015
- Deep Representations for Iris, Face, and Fingerprint Spoofing DetectionIEEE Transactions on Information Forensics and Security, 2015
- Face Anti-spoofing: Multi-spectral Approach2014
- Spoofing Face Recognition With 3D MasksIEEE Transactions on Information Forensics and Security, 2014
- Robust Pulse Rate From Chrominance-Based rPPGIEEE Transactions on Biomedical Engineering, 2013
- ROI Selection for Remote Photoplethysmography2013
- Exploiting the Circulant Structure of Tracking-by-Detection with Kernels2012
- Non-contact, automated cardiac pulse measurements using video imaging and blind source separationOptics Express, 2010
- Face Liveness Detection from a Single Image with Sparse Low Rank Bilinear Discriminative Model2010