%0 Journal Article %A Rafael López-González %A Jose Sánchez-García %A Belén Fos-Guarinos %A Fabio García-Castro %A Ángel Alberich-Bayarri %A Emilio Soria-Olivas %A Carlos Muñoz-Núñez %A Luis Martí-Bonmatí %T Automated Chest Radiographs Triage Reading by a Deep Learning Referee Network %D 2021 %R 10.1101/2021.06.01.21257399 %J medRxiv %P 2021.06.01.21257399 %X Chest radiographs are often obtained as a screening for early diagnosis tool to rule out abnormalities mainly related to different cardiovascular and respiratory diseases. Reading and reporting numerous chest radiographs is a complex and time-consuming task. This research proposes and evaluates a deep learning (DL) approach based on convolutional neural networks (CNN) combined with a referee fully connected neural network as a computer-aided diagnosis tool in chest X-ray triage and worklist prioritization. The CNN models were trained with a combination of three large scale databases: ChestX-ray14, CheXpert and PadChest. The final database contained 327,176 images labeled with findings obtained by natural language processing (NLP) techniques applied to the radiology reports. The dataset was split in 16 different balanced binary partitions, which were used to train 16 finding-specific classification CNNs. Afterwards, a normal vs abnormal partition of the dataset was created, being abnormal the presence of at least one pathologic change. This final partition was used to train a fully connected neural network as referee that was fed with all the 16 previously trained outcomes. The Area Under the Curve (AUC) analysis evaluated and compared the performance of the models. The system was successfully implemented and evaluated with a test set of 3400 images. The AUC of the normal vs abnormal classification was 0.94. The highest AUC of the finding-specific classifiers was 0.99 for hernia. The proposed system can be used to assist radiologists identifying abnormal exams, allowing a time-efficiency triage approach.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThere was no funding for the present work.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The databases used for the present study were ChestXray14, CheXpert and PAdChest. We got approval for using the three databases for research purposes after registration in the websites where the different databases are available. The ChestXray14 database was approved by the NIH Clinical Center ethical committee. The CheXpert database was approved by the Stanford Hospital ethical committee. The PadChest database was approved by the Hospital Universitario de San Juan ethical committee. All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data used in the present can be publicly accessed following the references included.CNNConvolutional Neural NetworkAUCArea Under the CurveCADComputer-Aided DiagnosisDLDeep LearningGPUGraphical Processing UnitSGDStochastic Gradient DescentCCECategorical Cross-EntropyNIHNational Institute of Health %U https://www.medrxiv.org/content/medrxiv/early/2021/06/01/2021.06.01.21257399.full.pdf