Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
Open Access
- 16 November 2021
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 16 (11) , e0259916
Abstract
Background: Atrial fibrillation (AFib) is the most common cardiac arrhythmia associated with stroke, blood clots, heart failure, coronary artery disease, and/or death. Multiple methods have been proposed for AFib detection, with varying performances, but no single approach appears to be optimal. We hypothesized that each state-of-the-art algorithm is appropriate for different subsets of patients and provides some independent information. Therefore, a set of suitably chosen algorithms, combined in a weighted voting framework, will provide a superior performance to any single algorithm. Methods: We investigate and modify 38 state-of-the-art AFib classification algorithms for a single-lead ambulatory electrocardiogram (ECG) monitoring device. All algorithms are ranked using a random forest classifier and an expert-labeled training dataset of 2,532 recordings. The seven top-ranked algorithms are combined by using an optimized weighting approach. Results: The proposed fusion algorithm, when validated on a separate test dataset consisting of 4,644 recordings, resulted in an area under the receiver operating characteristic (ROC) curve of 0.99. The sensitivity, specificity, positive-predictive-value (PPV), negative-predictive-value (NPV), and F1-score of the proposed algorithm were 0.93, 0.97, 0.87, 0.99, and 0.90, respectively, which were all superior to any single algorithm or any previously published. Conclusion: This study demonstrates how a set of well-chosen independent algorithms and a voting mechanism to fuse the outputs of the algorithms, outperforms any single state-of-the-art algorithm for AFib detection. The proposed framework is a case study for the general notion of crowdsourcing between open-source algorithms in healthcare applications. The extension of this framework to similar applications may significantly save time, effort, and resources, by combining readily existing algorithms. It is also a step toward the democratization of artificial intelligence and its application in healthcare.Keywords
Funding Information
- alivecor
- National Institute of Biomedical Imaging and Bioengineering (R01EB030362)
- National Center for Advancing Translational Sciences (UL1TR002378)
- National Center for Advancing Translational Sciences (UL1TR002378)
This publication has 48 references indexed in Scilit:
- Cross-validation pitfalls when selecting and assessing regression and classification modelsJournal of Cheminformatics, 2014
- Prediction of novel drug indications using network driven biological data prioritization and integrationJournal of Cheminformatics, 2014
- Crowd-Sourced Annotation of ECG Signals Using Contextual InformationAnnals of Biomedical Engineering, 2013
- Guidelines for the management of atrial fibrillation: The Task Force for the Management of Atrial Fibrillation of the European Society of Cardiology (ESC)European Heart Journal, 2010
- Epidemiology of Atrial Fibrillation The Rising Prevalence2008
- Identifying Feature Relevance Using a Random Forest2006
- PhysioBank, PhysioToolkit, and PhysioNetCirculation, 2000
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Bagging predictorsMachine Learning, 1996
- Support-vector networksMachine Learning, 1995