Abstract
Background With the global outbreak of COVID-19 epidemic since early 2020, there has been considerable attention on CT-based diagnosis as an effective and reliable method. Recently, the advent of deep learning in medical diagnosis has been well proven. Convolutional Neural Networks (CNN) can be used to detect the COVID-19 infection imaging features in a chest CT scan. We introduce ai-corona, a radiologist-assistant deep learning framework for COVID-19 infection diagnosis using the chest CT scans.
Method Our dataset comprises 2121 cases of axial spiral chest CT scans in three classes; COVID-19 abnormal, non COVID-19 abnormal, and normal, from which 1764 cases were used for training and 357 cases for validation. The training set was annotated using the reports of two experienced radiologists. The COVID-19 abnormal class validation set was annotated using the general consensus of a collective of criteria that indicate COVID-19 infection. Moreover, the validation sets for the non COVID-19 abnormal and the normal classes were annotated by a different experienced radiologist. ai-corona constitutes a CNN-based feature extractor conjoined with an average pooling and a fully-connected layer to classify a given chest CT scan into the three aforementioned classes.
Results We compare the diagnosis performance of ai-corona, radiologists, and model-assisted radiologists for six combinations of distinguishing between the three mentioned classes, including COVID-19 abnormal vs. others, COVID-19 abnormal vs. normal, COVID-19 abnormal vs. non COVID-19 abnormal, non COVID-19 abnormal vs. others, normal vs. others, and normal vs. abnormal. ai-corona achieves an AUC score of 0.989 (95% CI: 0.984, 0.994), 0.997 (95% CI: 0.995, 0.999), 0.986 (95% CI: 0.981, 0.991), 0.959 (95% CI: 0.944, 0.974), 0.978 (95% CI: 0.968, 0.988), and 0.961 (95% CI: 0.951, 0.971) in each combination, respectively. By employing Bayesian statistics to calculate the accuracies at a 95% confidence interval, ai-corona surpasses the radiologists in distinguishing between the COVID-19 abnormal class and the other two classes (especially the non COVID-19 abnormal class). Our results show that radiologists’ diagnosis performance improves when incorporating ai-corona’s prediction. In addition, we also show that RT-PCR’s diagnosis has a much lower sensitivity compared to all the other methods.
Conclusion ai-corona is a radiologist-assistant deep learning framework for fast and accurate COVID-19 diagnosis in chest CT scans. Our results ascertain that our framework, as a reliable detection tool, also improves experts’ diagnosis performance and helps especially in diagnosing non-typical COVID-19 cases or non COVID-19 abnormal cases that manifest COVID-19 imaging features in chest CT scan. Our framework is available at: ai-corona.com
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
No external or third party funding was received for our work.
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
↵* Main authors. mah.yousefzadeh{at}mail.sbu.ac.ir, parsa.esfahanian{at}ipm.ir
Data Availability
The data used in our work is not available to the public at the time of submission, but is subject to being made partially available in the future.
