mm-MuRe: mmWave-Based Multi-Subject Respiration Monitoring via End-to-End Deep Learning
- 22 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology
- Vol. 9 (1) , 49-61
Abstract
This study presents mm-MuRe, a novel method to perform multi-subject contactless respiration waveform monitoring by processing raw multiple-input-multiple-output mmWave radar data with an end-to-end deep neural network. The traditional vital signs monitoring signal processing scheme for mmWave radar involves analog or digital beamforming, human subject localization, phase variation extraction, filtering, and rate or biomarker analysis. This traditional method has many downsides, including sensitivity to selected beamforming weights and over-reliance on phase variation. To avoid these drawbacks, mm-MuRe (for MM-wave based MUlti-subject REspiration monitoring) is developed to improve reconstruction accuracy and reliability by taking in unprocessed 60 GHz MIMO FMCW radar data and outputting respiratory waveforms of interest, effectively mimicking an adaptive beamformer and bypassing the need for traditional localization and vital signs extraction techniques. Extensive testing across scenarios differing in range, angle, environment, and subject count demonstrates the network's robust performance, with an average cosine similarity exceeding 0.95. Results are compared to two baseline methods and show more than a 10% average improvement in waveform reconstruction accuracy across single and multi-subject scenarios. Coupled with a rapid inference time of 8.57 ms on a 10 s window of data, mm-MuRe shows promise for potential deployment to efficient and accurate near-real-time contactless respiration monitoring systems.Keywords
Funding Information
- National Science Foundation (2052780)
This publication has 23 references indexed in Scilit:
- Pi-ViMo: Physiology-inspired Robust Vital Sign Monitoring using mmWave RadarsACM Transactions on Internet of Things, 2023
- HeRe: Heartbeat Signal Reconstruction for Low-Power Millimeter-Wave Radar Based on Deep LearningIEEE Transactions on Instrumentation and Measurement, 2023
- Multi-Subject Heart Rate Estimation and Real-Time Tracking Using a mmWave Radar and Trace Carving Algorithm2022
- Multi-Target Vital Signs Remote Monitoring Using mmWave FMCW Radar2021
- Recent Advances in Radar-Based Sleep Monitoring — A Review2021
- A Survey of Convolutional Neural Networks: Analysis, Applications, and ProspectsIEEE Transactions on Neural Networks and Learning Systems, 2021
- Multitarget Vital Signs Measurement With Chest Motion Imaging Based on MIMO RadarIEEE Transactions on Microwave Theory and Techniques, 2021
- High-Accuracy Real-Time Monitoring of Heart Rate Variability Using 24 GHz Continuous-Wave Doppler RadarIEEE Access, 2019
- Monitoring vital signs using millimeter wave2016
- Maximal-Ratio Combining Architectures and Performance With Channel Estimation Based on a Training SequenceIEEE Transactions on Wireless Communications, 2004