Face2PPG: An Unsupervised Pipeline for Blood Volume Pulse Extraction From Faces
Top Cited Papers
Open Access
- 23 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (11) , 5530-5541
Abstract
Photoplethysmography (PPG) signals have become a key technology in many fields, such as medicine, well-being, or sports. Our work proposes a set of pipelines to extract remote PPG signals (rPPG) from the face robustly, reliably, and configurable. We identify and evaluate the possible choices in the critical steps of unsupervised rPPG methodologies. We assess a state-of-the-art processing pipeline in six different datasets, incorporating important corrections in the methodology that ensure reproducible and fair comparisons. In addition, we extend the pipeline by proposing three novel ideas; 1) a new method to stabilize the detected face based on a rigid mesh normalization; 2) a new method to dynamically select the different regions in the face that provide the best raw signals, and 3) a new RGB to rPPG transformation method, called Orthogonal Matrix Image Transformation (OMIT) based on QR decomposition, that increases robustness against compression artifacts. We show that all three changes introduce noticeable improvements in retrieving rPPG signals from faces, obtaining state-of-the-art results compared with unsupervised, non-learning-based methodologies and, in some databases, very close to supervised, learning-based methods. We perform a comparative study to quantify the contribution of each proposed idea. In addition, we depict a series of observations that could help in future implementations.Keywords
All Related Versions
Funding Information
- Research Council of Finland (346208)
- PROFI5 (326291)
This publication has 65 references indexed in Scilit:
- Improved motion robustness of remote-PPG by using the blood volume pulse signaturePhysiological Measurement, 2014
- Non-contact video-based pulse rate measurement on a mobile service robot2014
- Remote Heart Rate Measurement from Face Videos under Realistic Situations2014
- One millisecond face alignment with an ensemble of regression trees2014
- Robust Pulse Rate From Chrominance-Based rPPGIEEE Transactions on Biomedical Engineering, 2013
- Principal component analysis using QR decompositionInternational Journal of Machine Learning and Cybernetics, 2012
- Photoplethysmography and its application in clinical physiological measurementPhysiological Measurement, 2007
- PhysioBank, PhysioToolkit, and PhysioNetCirculation, 2000
- Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time seriesChaos: An Interdisciplinary Journal of Nonlinear Science, 1995
- Generalized QR factorization and its applicationsLinear Algebra and its Applications, 1992