PT - JOURNAL ARTICLE AU - Rashidi, Hooman H. AU - Pepper, John AU - Howard, Taylor AU - Klein, Karina AU - May, Larissa AU - Albahra, Samer AU - Phinney, Brett AU - Salemi, Michelle R. AU - Tran, Nam K. TI - COMPARATIVE PERFORMANCE OF TWO AUTOMATED MACHINE LEARNING PLATFORMS FOR COVID-19 DETECTION BY MALDI-TOF-MS AID - 10.1101/2022.02.02.22270298 DP - 2022 Jan 01 TA - medRxiv PG - 2022.02.02.22270298 4099 - http://medrxiv.org/content/early/2022/02/04/2022.02.02.22270298.short 4100 - http://medrxiv.org/content/early/2022/02/04/2022.02.02.22270298.full AB - The 2019 novel coronavirus infectious disease (COVID-19) pandemic has resulted in an unsustainable need for diagnostic tests. Currently, molecular tests are the accepted standard for the detection of SARS-CoV-2. Mass spectrometry (MS) enhanced by machine learning (ML) has recently been postulated to serve as a rapid, high-throughput, and low-cost alternative to molecular methods. Automated ML is a novel approach that could move mass spectrometry techniques beyond the confines of traditional laboratory settings. However, it remains unknown how different automated ML platforms perform for COVID-19 MS analysis. To this end, the goal of our study is to compare algorithms produced by two commercial automated ML platforms (Platforms A and B). Our study consisted of MS data derived from 361 subjects with molecular confirmation of COVID-19 status including SARS-CoV-2 variants. The top optimized ML model with respect to positive percent agreement (PPA) within Platforms A and B exhibited an accuracy of 94.9%, PPA of 100%, negative percent agreement (NPA) of 93%, and an accuracy of 91.8%, PPA of 100%, and NPA of 89%, respectively. These results illustrate the MS method’s robustness against SARS-CoV-2 variants and highlight similarities and differences in automated ML platforms in producing optimal predictive algorithms for a given dataset.Competing Interest StatementN.T. is a consultant for Roche Diagnostics and Roche Molecular Systems. He is also a co-inventor / co-owner of MILO-ML, LLC. H.R. is also a co-inventor / co-owner of MILO-ML, LLC. J.P. is a co-founder and employee of SpectraPass, LLC. L.M. is a consultant for Roche Diagnostics and Roche Molecular Systems. S.A. is a co-inventor / co-owner of MILO-ML, LLC. T.H., K.K., B.P., and M.S. have no competing interests.Funding StatementN.T., H.R., L.M., K.K., T.H., B.P., and M.S. are funded under a sponsored study agreement between UC Davis and SpectraPass, LLC. S.A. received no specific funding for this work. J.P. is an employee of SpectraPass, LLC. SpectraPass, LLC is developing this assay in partnership with UC Davis investigators and were involved with study design, data analysis, decision to publish.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.Not ApplicableThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The UC Davis Institutional Review Board approved this study.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.Not ApplicableI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Not ApplicableI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.Not ApplicableRequests should be submitted to UC Davis and SpectraPass investigators. A formal material transfer agreement would need to be set up. Shared data would be limited to de-identified information.