Assessing Electrocardiogram and Respiratory Signal Quality of a Wearable Device (SensEcho): Semisupervised Machine Learning-Based Validation Study
Open Access
- 12 August 2021
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 9 (8) , e25415
Abstract
Background: With the development and promotion of wearable devices and their mobile health (mHealth) apps, physiological signals have become a research hotspot. However, noise is complex in signals obtained from daily lives, making it difficult to analyze the signals automatically and resulting in a high false alarm rate. At present, screening out the high-quality segments of the signals from huge-volume data with few labels remains a problem. Signal quality assessment (SQA) is essential and is able to advance the valuable information mining of signals. Objective: The aims of this study were to design an SQA algorithm based on the unsupervised isolation forest model to classify the signal quality into 3 grades: good, acceptable, and unacceptable; validate the algorithm on labeled data sets; and apply the algorithm on real-world data to evaluate its efficacy. Methods: Data used in this study were collected by a wearable device (SensEcho) from healthy individuals and patients. The observation windows for electrocardiogram (ECG) and respiratory signals were 10 and 30 seconds, respectively. In the experimental procedure, the unlabeled training set was used to train the models. The validation and test sets were labeled according to preset criteria and used to evaluate the classification performance quantitatively. The validation set consisted of 3460 and 2086 windows of ECG and respiratory signals, respectively, whereas the test set was made up of 4686 and 3341 windows of signals, respectively. The algorithm was also compared with self-organizing maps (SOMs) and 4 classic supervised models (logistic regression, random forest, support vector machine, and extreme gradient boosting). One case validation was illustrated to show the application effect. The algorithm was then applied to 1144 cases of ECG signals collected from patients and the detected arrhythmia false alarms were calculated. Results: The quantitative results showed that the ECG SQA model achieved 94.97% and 95.58% accuracy on the validation and test sets, respectively, whereas the respiratory SQA model achieved 81.06% and 86.20% accuracy on the validation and test sets, respectively. The algorithm was superior to SOM and achieved moderate performance when compared with the supervised models. The example case showed that the algorithm was able to correctly classify the signal quality even when there were complex pathological changes in the signals. The algorithm application results indicated that some specific types of arrhythmia false alarms such as tachycardia, atrial premature beat, and ventricular premature beat could be significantly reduced with the help of the algorithm. Conclusions: This study verified the feasibility of applying the anomaly detection unsupervised model to SQA. The application scenarios include reducing the false alarm rate of the device and selecting signal segments that can be used for further research.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- ECG Signal Quality During Arrhythmia and Its Application to False Alarm ReductionIEEE Transactions on Biomedical Engineering, 2013
- Predicting clinical deterioration in the hospital: The impact of outcome selectionResuscitation, 2013
- Damage classification in structural health monitoring using principal component analysis and self-organizing mapsStructural Control and Health Monitoring, 2012
- Signal quality and data fusion for false alarm reduction in the intensive care unitJournal of Electrocardiology, 2012
- Identification of deteriorating patients on general wards; measurement of vital parameters and potential effectiveness of the Modified Early Warning ScoreJournal of Critical Care, 2012
- A review of wearable sensors and systems with application in rehabilitationJournal of NeuroEngineering and Rehabilitation, 2012
- Self-Organizing Maps of Nutrition, Lifestyle and Health Situation in the WorldLecture Notes in Computer Science, 2011
- Electrocardiogram data mining based on frame classification by dynamic time warping matchingComputer Methods in Biomechanics and Biomedical Engineering, 2009
- Robust heart rate estimation from multiple asynchronous noisy sources using signal quality indices and a Kalman filterPhysiological Measurement, 2007
- Dynamic Time Warping2007