Comparative performance of two automated machine learning platforms for COVID-19 detection by MALDI-TOF-MS
Open Access
- 29 July 2022
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (7) , e0263954
Abstract
The 2019 novel coronavirus infectious disease (COVID-19) pandemic has resulted in an unsustainable need for diagnostic tests. Currently, molecular tests are the accepted standard for the detection of SARS-CoV-2. Mass spectrometry (MS) enhanced by machine learning (ML) has recently been postulated to serve as a rapid, high-throughput, and low-cost alternative to molecular methods. Automated ML is a novel approach that could move mass spectrometry techniques beyond the confines of traditional laboratory settings. However, it remains unknown how different automated ML platforms perform for COVID-19 MS analysis. To this end, the goal of our study is to compare algorithms produced by two commercial automated ML platforms (Platforms A and B). Our study consisted of MS data derived from 361 subjects with molecular confirmation of COVID-19 status including SARS-CoV-2 variants. The top optimized ML model with respect to positive percent agreement (PPA) within Platforms A and B exhibited an accuracy of 94.9%, PPA of 100%, negative percent agreement (NPA) of 93%, and an accuracy of 91.8%, PPA of 100%, and NPA of 89%, respectively. These results illustrate the MS method’s robustness against SARS-CoV-2 variants and highlight similarities and differences in automated ML platforms in producing optimal predictive algorithms for a given dataset.Keywords
All Related Versions
Funding Information
- SpectraPass, LLC
- SpectraPass, LLC
- SpectraPass, LLC
- SpectraPass, LLC
- SpectraPass, LLC
- SpectraPass, LLC
- SpectraPass, LLC
This publication has 19 references indexed in Scilit:
- Evolution and impact of bias in human and machine learning algorithm interactionPLOS ONE, 2020
- Detection of SARS-CoV-2 in nasal swabs using MALDI-MSNature Biotechnology, 2020
- Novel application of an automated-machine learning development tool for predicting burn sepsis: proof of conceptScientific Reports, 2020
- Proteotyping SARS-CoV-2 Virus from Nasopharyngeal Swabs: A Proof-of-Concept Focused on a 3 Min Mass Spectrometry WindowJournal of Proteome Research, 2020
- COVID-19 in Latin AmericaThe Lancet Infectious Diseases, 2020
- Machine intelligence in healthcare—perspectives on trustworthiness, explainability, usability, and transparencynpj Digital Medicine, 2020
- Machine Learning at Microsoft with ML.NET2019
- Artificial Intelligence and Machine Learning in Pathology: The Present Landscape of Supervised MethodsAcademic Pathology, 2019
- Potential Biases in Machine Learning Algorithms Using Electronic Health Record DataJAMA Internal Medicine, 2018
- MALDI-TOF MS for the Diagnosis of Infectious DiseasesClinical Chemistry, 2015