RT Journal Article
SR Electronic
T1 The Effect of Image Resolution on Automated Classification of Chest X-rays
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2021.07.30.21261225
DO 10.1101/2021.07.30.21261225
A1 Haque, Md Inzamam Ul
A1 Dubey, Abhishek K.
A1 Hinkle, Jacob D.
YR 2021
UL http://medrxiv.org/content/early/2021/08/01/2021.07.30.21261225.abstract
AB Deep learning models have received much attention lately for their ability to achieve expert-level performance on the accurate automated analysis of chest X-rays. Although publicly available chest X-ray datasets include high resolution images, most models are trained on reduced size images due to limitations on GPU memory and training time. As compute capability continues to advance, it will become feasible to train large convolutional neural networks on high-resolution images. To verify that this will lead to increased performance, we perform a systematic evaluation to measure the effect of input chest X-ray image resolution on accuracy. This study is based on the publicly available MIMIC-CXR-JPG dataset, comprising 377,110 high resolution chest X-ray images, and provided with 14 labels to the corresponding free-text radiology reports. Our original hypothesis that increased resolution would lead to higher accuracy held true for some but not all of the tasks. We find, interestingly, that tasks that require a large receptive field are better suited to downscaled input images, and we verify this qualitatively by inspecting effective receptive fields and class activation maps of trained models. Finally, we show that stacking an ensemble across resolutions outperforms each individual learner at all input resolutions while providing interpretable scale weights, suggesting that multi-scale features are crucially important to information extraction from high-resolution chest X-rays.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis manuscript has been authored in part by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results offederally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan). This work has been supported in part by the Artificial Intelligence Initiative at Oak Ridge National Laboratory. This research used resources of the Compute and Data Environment for Science (CADES) at the Oak Ridge National Laboratory, which is supported by the Office of Science of DOE.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The present study used the MIMIC-CXR-JPG dataset which was made available after registration under the PhysioNet Credentialed Health Data Use Agreement 1.5.0 for the MIMIC-CXR-JPG - chest radiographs with structured labels (v2.0.0). The MIMIC-CXR and MIMIC-CXR-JPG datasets were acquired at Beth Israel Deaconess Medical Center (BIDMC, Boston, MA) under a project approved by the Institutional Review Board of BIDMC. Requirement for individual patient consent in the original data collection was waived because the project did not impact clinical care and all protected health information was removed.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThis manuscript uses the MIMIC-CXR-JPG dataset, which is available to the public upon request. https://physionet.org/content/mimic-cxr-jpg/2.0.0/