Standardized rPPG signal generation based on generative adversarial networks
- 1 January 2024
- journal article
- research article
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 33 (01) , 013032-14
Abstract
Remote photoplethysmography (rPPG) is an optical technique that measures physiological signals from facial videos by analyzing subtle changes in the skin blood volume. However, rPPG signals generated in practical applications are easily affected by external environmental factors and the state of individuals, leading to irregular waveform variations that increase the difficulty in heart rate estimation. To improve the regularity of generated rPPG signals, we propose a standardized rPPG signal generation method. Specifically, facial videos are fed into the generator of a generative adversarial network (GAN) to predict a rough rPPG signal by supervised learning. In addition, a mathematical signal synthesizer model is used to generate noise-free standardized rPPG signals, which are subsequently fed into a discriminator along with the predicted signal for adversarial learning. This enables the generator to learn more standardized waveforms. As a result, the predicted signal waveform by the generator becomes closer to the waveform distribution of real rPPG signals. The proposed method is validated on the widely used MAHNOB-HCI, UBFC-rPPG, and MMSE-HR databases and shows significant improvements in the prediction accuracy and signal-to-noise ratio.Keywords
This publication has 23 references indexed in Scilit:
- Multi-Stage CNN Architecture for Face Mask Detection2021
- A novel one-stage framework for visual pulse rate estimation using deep neural networksBiomedical Signal Processing and Control, 2021
- Unsupervised skin tissue segmentation for remote photoplethysmographyPattern Recognition Letters, 2019
- DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks2018
- Local Group Invariance for Heart Rate Estimation from Face Videos in the Wild2018
- Heart Rate Variability Extraction From Videos Signals: ICA vs. EVM ComparisonIEEE Access, 2017
- Self-Adaptive Matrix Completion for Heart Rate Estimation from Face Videos under Realistic Conditions2016
- Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis2016
- Remote Heart Rate Measurement from Face Videos under Realistic Situations2014
- PCA in studying coordination and variability: a tutorialClinical Biomechanics, 2004