RT Journal Article
SR Electronic
T1 Development, evaluation, and validation of machine learning models for COVID-19 detection based on routine blood tests
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2020.10.02.20205070
DO 10.1101/2020.10.02.20205070
A1 Cabitza Federico
A1 Campagner Andrea
A1 Ferrari Davide
A1 Di Resta Chiara
A1 Ceriotti Daniele
A1 Sabetta Eleonora
A1 Colombini Alessandra
A1 De Vecchi Elena
A1 Banfi Giuseppe
A1 Locatelli Massimo
A1 Carobene Anna
YR 2020
UL http://medrxiv.org/content/early/2020/10/04/2020.10.02.20205070.abstract
AB Background The rRT-PCR test, the current gold standard for the detection of coronavirus disease (COVID-19), presents with known shortcomings, such as long turnaround time, potential shortage of reagents, false-negative rates around 15–20%, and expensive equipment. The hematochemical values of routine blood exams could represent a faster and less expensive alternative.Methods Three different training data set of hematochemical values from 1,624 patients (52% COVID-19 positive), admitted at San Raphael Hospital (OSR) from February to May 2020, were used for developing machine learning (ML) models: the complete OSR dataset (72 features: complete blood count (CBC), biochemical, coagulation, hemogasanalysis and CO-Oxymetry values, age, sex and specific symptoms at triage) and two sub-datasets (COVID-specific and CBC dataset, 32 and 21 features respectively). 58 cases (50% COVID-19 positive) from another hospital, and 54 negative patients collected in 2018 at OSR, were used for internal-external and external validation.Results We developed five ML models: for the complete OSR dataset, the area under the receiver operating characteristic curve (AUC) for the algorithms ranged from 0.83 to 0.90; for the COVID-specific dataset from 0.83 to 0.87; and for the CBC dataset from 0.74 to 0.86. The validations also achieved good results: respectively, AUC from 0.75 to 0.78; and specificity from 0.92 to 0.96.Conclusions ML can be applied to blood tests as both an adjunct and alternative method to rRT-PCR for the fast and cost-effective identification of COVID-19-positive patients. This is especially useful in developing countries, or in countries facing an increase in contagions.Competing Interest StatementThe authors have declared no competing interest.Funding StatementNo external funding was receivedAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The study protocol (BIGDATA-COVID19) was approved by the Institutional Ethical Review Board (70/INT/2020) of IRCCS San Raffaele Scientific Institute, in agreement with the World Medical Association Declaration of Helsinki, on April 20th 2020, and authorized on April 22nd 2020.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe datasets collected and used in this study are available from the corresponding author on reasonable request.List of abbreviationsALPAlkaline PhosphataseALTAlanine AminotransferaseANGPOCAnion gapASTAspartate AminotransferaseAUCArea under the curveBABasophils count (%)BATBasophils countBEEPOCActual Base ExcessBEPOCBase ExcessBICPOCBicarbonatesBILDDirect BilirubinBILINIndirect BilirubinBILTTotal BilirubinBISPOCStandard Calculated BicarbonatesBO2POCBound O2 Maximum ConcentrationCACalciumCAPOCIonized Calcium (POC)CASPOCStandard Ionized Calcium(POC)CBCcomplete blood countCKCreatine kinaseCLPOCChloride (POC)CO2POCCarbonic Anhydride (pCO2)CREACreatinineCRPC-reactive ProteinCTcomputed tomographyCTOPOCTotal OxygenEDemergency departmentEOEosinophils count (%)EOTEosinophils countFCOPOCCarboxyhemoglobinFGFibrinogenFIOPOCInspired Oxygen FractionFO2POCOxyhemoglobin / Total HemoglobinGGTGamma GlutamyltransferaseGLUGlucoseGLUEMGlucose Blood GasOHCTHematocritHCTPOCHematocrit (POC)HGBHemoglobinHHBPOCDeoxyhemoglobinIL6Interleukin 6IOGIstituto Ortopedico GaleazziKPotassiumKNNk-nearest neighborsKPOCPotassium (POC)LATPOCLactate (POC)LDHLactate DehydrogenaseLRlogistic regressionLYLymphocytes count (%)LYTLymphocytes countMCHMean Corpuscolar HemoglobinMCHCMean Corpuscolar Hemoglobin ConcentrationMCVAverage Globular VolumeMETPOCMethemoglobinMLmachine learningMOMonocytes count (%)MOTMonocytes countMPVAverage Platelet VolumeNASodiumNAPOCSodium (POC)NBNaive BayesNENeutrophils count (%)NETNeutrophils countNPVNegative predictive ValueOFIPOCInspired O2 / O2 ratioOSROspedale San RaffaelePCRPolymerase Chain ReactionPHPOCpHPLTPlatelets PO2POC Oxygen (pO2)PPTRActivated partial thromboplastin time (R)PPVpositive predictive valuePROBNPNT-proB-type Natriuretic PeptidePTINRProthrombin Time (INR)rRT-PCRreverse transcription polymerase chain reactionRBCRed Blood CellsRDWErythrocyte distribution widthRFrandom forestROCreceiver operating characteristicRT-PCRreverse transcriptase–PCRSO2POCO2 SaturationSVMsupport vector machineTHBPOCTotal OxyhemoglobinTROPOTTroponin TUREAUreaWBCWhite blood cellsXDPD-Dimer