Local Group Invariance for Heart Rate Estimation from Face Videos in the Wild
Authors:
- Christian S. PilzCPChristian S. Pilz
- Sebastian ZaunsederSZSebastian Zaunseder
- Jarek KrajewskiJKJarek Krajewski
- Vladimir BlazekVBVladimir Blazek
- 1 June 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1335-13358
Abstract
We study the impact of prior knowledge about invariance for the task of heart rate estimation from face videos in the wild (e.g. in presence of disturbing factors like rigid head motion, talking, facial expressions and natural illumination conditions under different scenarios). We introduce features invariant with respect to the action of a differentiable local group of local transformations. As result, the energy of the blood volume signal is re-arranged in vector space with a more concentrated distribution. The uncertainty in the feature distribution is incorporated with a model that leverages the local invariance of the heart rate. During experiments the method achieved strong estimation performance of heart rate from face videos in the wild. To demonstrate the potential of the approach it is compared against recent algorithms on data collected to study the impact of the mentioned nuisance attributes. To facilitate future comparisons, we made the code and data for reproducing the results publicly available.Keywords
This publication has 32 references indexed in Scilit:
- Supervised learning approach to remote heart rate estimation from facial videos2015
- Improved motion robustness of remote-PPG by using the blood volume pulse signaturePhysiological Measurement, 2014
- Non-contact video-based vital sign monitoring using ambient light and auto-regressive modelsPhysiological Measurement, 2014
- Robust Pulse Rate From Chrominance-Based rPPGIEEE Transactions on Biomedical Engineering, 2013
- Cues of Fatigue: Effects of Sleep Deprivation on Facial AppearanceSLEEP, 2013
- Non-contact, automated cardiac pulse measurements using video imaging and blind source separationOptics Express, 2010
- Least-squares estimation of transformation parameters between two point patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991
- The interacting multiple model algorithm for systems with Markovian switching coefficientsIEEE Transactions on Automatic Control, 1988
- Optoelektronische Erfassung und rechnerunterstützte Analyse der Mikrozirkulations-RhythmikBiomedical Engineering / Biomedizinische Technik, 1985
- Photoelectric Plethysmography of the Fingers and Toes in ManExperimental Biology and Medicine, 1937