PulseEdit: Editing Physiological Signals in Facial Videos for Privacy Protection
- 13 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 17 (15566013) , 457-471
Abstract
Recent studies have shown that physiological signals such as heart beat and breathing can be remotely captured from human faces using a regular color camera under ambient light. This technology, referred to as remote photoplethysmography (rPPG), can be used to collect the physiological status of users who are in front of a camera, which may raise privacy concerns. To avoid the privacy abuse of the rPPG technology, this paper develops PulseEdit, a novel and efficient algorithm that can edit the physiological signals in facial videos without affecting visual appearance and thus protect the user’s physiological signal from disclosure. PulseEdit can either remove the trace of the physiological signal in a video or transform the video to contain a target physiological signal chosen by a user. Experimental results show that PulseEdit can effectively edit physiological signals in facial videos and prevent heart rate measurement based on rPPG. It is possible to utilize PulseEdit in adversarial scenarios against rPPG-based visual security algorithms. We present analyses on the performance of PulseEdit against rPPG-based liveness detection and rPPG-based deepfake detection, and demonstrate its ability to circumvent these visual security algorithms and its important role in supporting the design of attack-resilient systems.Keywords
All Related Versions
Funding Information
- United States National Science Foundation (2030502)
This publication has 49 references indexed in Scilit:
- Privacy Protection in Biometric-Based Recognition Systems: A marriage between cryptography and signal processingIEEE Signal Processing Magazine, 2015
- Rich model for Steganalysis of color images2014
- One millisecond face alignment with an ensemble of regression trees2014
- Robust Pulse Rate From Chrominance-Based rPPGIEEE Transactions on Biomedical Engineering, 2013
- Detecting Pulse from Head Motions in Video2013
- Eulerian video magnification for revealing subtle changes in the worldACM Transactions on Graphics, 2012
- $\ell_1$ Trend FilteringSIAM Review, 2009
- A Multi-biometric Verification System for the Privacy Protection of Iris Templates2008
- Biometric recognition: security and privacy concernsIEEE Security & Privacy, 2003
- Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images2002