Shuffle-rPPGNet: Efficient Network With Global Context for Remote Heart Rate Variability Measurement
- 31 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 23 (13) , 15199-15209
Abstract
In the field of remote physiological indicator measurement, there are relatively few studies on measuring heart rate variability (HRV). Moreover, some methods using deep neural networks are computationally intensive due to high network complexity. In this paper, a HRV measurement method is proposed based on an efficient three dimensional convolutional neural network (3DCNN) model defined as Shuffle-rPPGNet. The basic idea of the proposed method is to extract more precise remote photoplethysmography (rPPG) signals from facial videos by this model and then calculate relevant indicators of HRV through the post-processed rPPG signals. Shuffle-rPPGNet uses a lightweight network structure named ShuffleNetV2 as a baseline to construct an efficient 3DCNN with additional parts including 3D Global Context, 3D Channel Shuffle and Up-sample blocks, etc. The proposed method has been evaluated on two public datasets, i.e., UBFC-rPPG and PURE datasets. The results show that the proposed method has better performance in HRV measurement compared to the state-of-the-art methods. Especially, the mean absolute errors of the average values of the normal-to-normal interval sequence reach 2.35 and 6.62 respectively on these two public datasets.Keywords
Funding Information
- National Natural Science Foundation of China (61772088)
This publication has 33 references indexed in Scilit:
- Unsupervised skin tissue segmentation for remote photoplethysmographyPattern Recognition Letters, 2019
- Video pulse rate variability analysis in stationary and motion conditionsBioMedical Engineering OnLine, 2018
- Algorithmic Principles of Remote PPGIEEE Transactions on Biomedical Engineering, 2016
- Non-contact video-based pulse rate measurement on a mobile service robot2014
- Fast Inter-Harmonic Reconstruction for Spectral Envelope Estimation in High-Pitched VoicesIEEE Signal Processing Letters, 2014
- Remote Heart Rate Measurement from Face Videos under Realistic Situations2014
- Robust Pulse Rate From Chrominance-Based rPPGIEEE Transactions on Biomedical Engineering, 2013
- Detecting Pulse from Head Motions in Video2013
- Remote plethysmographic imaging using ambient lightOptics Express, 2008
- Heart Rate Variability from Short Electrocardiographic Recordings Predicts Mortality from All Causes in Middle-aged and Elderly Men: The Zutphen StudyAmerican Journal of Epidemiology, 1997