RT Journal Article
SR Electronic
T1 Validation of expert system enhanced deep learning algorithm for automated screening for COVID-Pneumonia on chest X-rays
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2020.10.20.20213793
DO 10.1101/2020.10.20.20213793
A1 Gidde, Prashant Sadashiv
A1 Prasad, Shyam Sunder
A1 Singh, Ajay Pratap
A1 Bhatheja, Nitin
A1 Prakash, Satyartha
A1 Singh, Prateek
A1 Saboo, Aakash
A1 Thakar, Rohit
A1 Gupta, Salil
A1 Saurav, Sumeet
A1 Raghunandanan, M V
A1 Singh, Amritpal
A1 Sardana, Viren
A1 Mahajan, Harsh
A1 Kalyanpur, Arjun
A1 Mandal, Atanendu Shekhar
A1 Mahajan, Vidur
A1 Agrawal, Anurag
A1 Agrawal, Anjali
A1 Venugopal, Vasantha Kumar
A1 Singh, Sanjay
A1 Dash, Debasis
YR 2020
UL http://medrxiv.org/content/early/2020/10/21/2020.10.20.20213793.abstract
AB The coronavirus disease of 2019 (COVID-19) pandemic exposed a limitation of artificial intelligence (AI) based medical image interpretation systems. Early in the pandemic, when need was greatest, the absence of sufficient training data prevented effective deep learning (DL) solutions. Even now, there is a need for Chest-X-ray (CxR) screening tools in low and middle income countries (LMIC), when RT-PCR is delayed, to exclude COVID-19 pneumonia (Cov-Pneum) requiring transfer to higher care. In absence of local LMIC data and poor portability of CxR DL algorithms, a new approach is needed. Axiomatically, it is faster to repurpose existing data than to generate new datasets. Here, we describe CovBaseAI, an explainable tool which uses an ensemble of three DL models and an expert decision system (EDS) for Cov-Pneum diagnosis, trained entirely on datasets from the pre-COVID-19 period. Portability, performance, and explainability of CovBaseAI was primarily validated on two independent datasets. First, 1401 randomly selected CxR from an Indian quarantine-center to assess effectiveness in excluding radiologic Cov-Pneum that may require higher care. Second, a curated dataset with 434 RT-PCR positive cases of varying levels of severity and 471 historical scans containing normal studies and non-COVID pathologies, to assess performance in advanced medical settings. CovBaseAI had accuracy of 87% with negative predictive value of 98% in the quarantine-center data for Cov-Pneum. However, sensitivity varied from 0.66 to 0.90 depending on whether RT-PCR or radiologist opinion was set as ground truth. This tool with explainability feature has better performance than publicly available algorithms trained on COVID-19 data but needs further improvement.Competing Interest StatementCARPL is a commercial product owned by CARING (Mahajan Imaging) and was utilized for this work as a part of R\&D MoU between CSIR-IGIB and Mahajan Imaging.Funding StatementThis activity is partially funded by project MLP-2002 (CSIR-IGIB) and CSIR-Intelligent Systems Mission Mode Project (CSIR-CEERI) of Council of Scientific and Industrial Research (CSIR), India.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Institute Human Ethics Committee, CSIR-IGIB, New Delhi Ref# - CSIR-IGIB/IHEC/2020-21/02 Dated - 28/03/2020All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Yes I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe datasets used are available at https://covbase4all.igib.res.in/ https://covbase4all.igib.res.in/ The datasets used are available at https://covbase4all.igib.res.in/ https://covbase4all.igib.res.in/