RobustPPG: camera-based robust heart rate estimation using motion cancellation
- 26 September 2022
- journal article
- research article
- Published by Optica Publishing Group in Biomedical Optics Express
- Vol. 13 (10) , 5447-5467
Abstract
Camera-based heart rate measurement is becoming an attractive option as a non-contact modality for continuous remote health and engagement monitoring. However, reliable heart rate extraction from camera-based measurement is challenging in realistic scenarios, especially when the subject is moving. In this work, we develop a motion-robust algorithm, labeled RobustPPG, for extracting photoplethysmography signals (PPG) from face video and estimating the heart rate. Our key innovation is to explicitly model and generate motion distortions due to the movements of the person’s face. We use inverse rendering to obtain the 3D shape and albedo of the face and environment lighting from video frames and then render the human face for each frame. The rendered face is similar to the original face but does not contain the heart rate signal; facial movements alone cause pixel intensity variation in the generated video frames. Finally, we use the generated motion distortion to filter the motion-induced measurements. We demonstrate that our approach performs better than the state-of-the-art methods in extracting a clean blood volume signal with over 2 dB signal quality improvement and 30% improvement in RMSE of estimated heart rate in intense motion scenarios.Keywords
Funding Information
- National Science Foundation (Grant - NSF-1730574)
- Snap, Inc.
This publication has 22 references indexed in Scilit:
- Photoplethysmography Revisited: From Contact to Noncontact, From Point to ImagingIEEE Transactions on Biomedical Engineering, 2015
- DistancePPG: Robust non-contact vital signs monitoring using a cameraBiomedical Optics Express, 2015
- Improved motion robustness of remote-PPG by using the blood volume pulse signaturePhysiological Measurement, 2014
- Signal recovery in imaging photoplethysmographyPhysiological Measurement, 2013
- Robust Pulse Rate From Chrominance-Based rPPGIEEE Transactions on Biomedical Engineering, 2013
- Self-calibrated, Multi-spectral Photometric Stereo for 3D Face CaptureInternational Journal of Computer Vision, 2011
- Motion-compensated noncontact imaging photoplethysmography to monitor cardiorespiratory status during exerciseJournal of Biomedical Optics, 2011
- Structured-light 3D surface imaging: a tutorialAdvances in Optics and Photonics, 2011
- Non-contact, automated cardiac pulse measurements using video imaging and blind source separationOptics Express, 2010
- Using color to separate reflection componentsColor Research & Application, 1985