Scalable Approach to Consumer Wearable Postmarket Surveillance: Development and Validation Study
Open Access
- 4 April 2024
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 12 (1) , e51171
Abstract
Background: With the capability to render prediagnoses, consumer wearables have the potential to affect subsequent diagnoses and the level of care in the health care delivery setting. Despite this, postmarket surveillance of consumer wearables has been hindered by the lack of codified terms in electronic health records (EHRs) to capture wearable use. Objective: We sought to develop a weak supervision–based approach to demonstrate the feasibility and efficacy of EHR-based postmarket surveillance on consumer wearables that render atrial fibrillation (AF) prediagnoses. Methods: We applied data programming, where labeling heuristics are expressed as code-based labeling functions, to detect incidents of AF prediagnoses. A labeler model was then derived from the predictions of the labeling functions using the Snorkel framework. The labeler model was applied to clinical notes to probabilistically label them, and the labeled notes were then used as a training set to fine-tune a classifier called Clinical-Longformer. The resulting classifier identified patients with an AF prediagnosis. A retrospective cohort study was conducted, where the baseline characteristics and subsequent care patterns of patients identified by the classifier were compared against those who did not receive a prediagnosis. Results: The labeler model derived from the labeling functions showed high accuracy (0.92; F1-score=0.77) on the training set. The classifier trained on the probabilistically labeled notes accurately identified patients with an AF prediagnosis (0.95; F1-score=0.83). The cohort study conducted using the constructed system carried enough statistical power to verify the key findings of the Apple Heart Study, which enrolled a much larger number of participants, where patients who received a prediagnosis tended to be older, male, and White with higher CHA2DS2-VASc (congestive heart failure, hypertension, age ≥75 years, diabetes, stroke, vascular disease, age 65-74 years, sex category) scores (P<.001). We also made a novel discovery that patients with a prediagnosis were more likely to use anticoagulants (525/1037, 50.63% vs 5936/16,560, 35.85%) and have an eventual AF diagnosis (305/1037, 29.41% vs 262/16,560, 1.58%). At the index diagnosis, the existence of a prediagnosis did not distinguish patients based on clinical characteristics, but did correlate with anticoagulant prescription (P=.004 for apixaban and P=.01 for rivaroxaban). Conclusions: Our work establishes the feasibility and efficacy of an EHR-based surveillance system for consumer wearables that render AF prediagnoses. Further work is necessary to generalize these findings for patient populations at other sites.Keywords
This publication has 14 references indexed in Scilit:
- Weakly supervised spatial relation extraction from radiology reportsJAMIA Open, 2023
- A comparative study of pretrained language models for long clinical textJournal of the American Medical Informatics Association, 2022
- Will Apple devices’ passive atrial fibrillation detection prevent strokes? Estimating the proportion of high-risk actionable patients with real-world user dataJournal of the American Medical Informatics Association, 2022
- A weakly supervised model for the automated detection of adverse events using clinical notesJournal of Biomedical Informatics, 2022
- Ontology-driven weak supervision for clinical entity classification in electronic health recordsNature Communications, 2021
- Clinical evaluation and diagnostic yield following evaluation of abnormal pulse detected using Apple WatchJournal of the American Medical Informatics Association, 2020
- SciPy 1.0: fundamental algorithms for scientific computing in PythonNature Methods, 2020
- Large-Scale Assessment of a Smartwatch to Identify Atrial FibrillationNew England Journal of Medicine, 2019
- Medical device surveillance with electronic health recordsnpj Digital Medicine, 2019
- Snorkel: rapid training data creation with weak supervisionThe VLDB Journal, 2019