ABSTRACT
Objectives to evaluate the performance of Artificial Intelligence (AI) methods to detect covid-19 from chest images (X-Ray and CT scans).
Methods Chest CT scans and X-Ray images collected from different centers and institutions were downloaded and combined together. Images were separated by patient and 66% of the patients were used to develop and train AI image-based classifiers. Then, the AI automated classifiers were evaluated on a separate set of patients (the remaining 33% patients).
Results (Chest X-Ray) Five different data sources were combined for a total of N=9,841 patients (1,733 with covid-19, 810 with bacterial tuberculosis and 7,298 healthy patients). The test sample size was N=3,528 patients. The best AI method reached an Area Under the Curve (AUC) for covid-19 detection of 99%, with a detection rate of 96.4% at 1.0% false positive rate.
Results (Chest CT scans) Two different data sources were combined for a total of N=363 patients (191 having covid-19 and 172 healthy patients). The test sample size was N=121 patients. The best AI method reached an AUC for covid-19 detection of 90.9%, with a detection rate of 90.6% at 24.6% false positive rate.
Conclusions Computer aided automatic covid-19 detection from chest X-ray images showed promising results to be used as screening tool during the covid-19 outbreak. The developed method may help to manage patients better in case access to PCR testing is not possible or to detect patients with symptoms missed in a first round of PCR testing. The method will be made available online (www.quantuscovid19.org). These results merit further evaluation collecting more images. We hope this study will allow us to start such collaborations.
Competing Interest Statement
All authors are Transmural Biotech employees
Funding Statement
This work in its entirety was supported by Transmural Biotech SL.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
External open research datasets were used, we were not responsible for data acquisition in any way (patient consent, ethical board approval, etc.)
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
All data used comes from external open research sources available online. The rest of data is available in the main text. The final X-Ray model will be provided online at https://www.quantuscovid19.org
