RT Journal Article
SR Electronic
T1 Image- vs. histogram-based considerations in semantic segmentation of pulmonary hyperpolarized gas images
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2021.03.04.21252588
DO 10.1101/2021.03.04.21252588
A1 Nicholas J. Tustison
A1 Talissa A. Altes
A1 Kun Qing
A1 Mu He
A1 G. Wilson Miller
A1 Brian B. Avants
A1 Yun M. Shim
A1 James C. Gee
A1 John P. Mugler III
A1 Jaime F. Mata
YR 2021
UL http://medrxiv.org/content/early/2021/03/23/2021.03.04.21252588.abstract
AB Magnetic resonance imaging (MRI) using hyperpolarized gases has made possible the novel visualization of airspaces in the human lung, which has advanced research into the growth, development, and pathologies of the pulmonary system. In conjunction with the innovations associated with image acquisition, multiple image analysis strategies have been proposed and refined for the quantification of such lung imaging with much research effort devoted to semantic segmentation, or voxelwise classification, into clinically oriented categories based on ventilation levels. Given the functional nature of these images and the consequent sophistication of the segmentation task, many of these algorithmic approaches reduce the complex spatial image information to intensity-only considerations, which can be contextualized in terms of the intensity histogram. Although facilitating computational processing, this simplifying transformation results in the loss of important spatial cues for identifying salient image features, such as ventilation defects (a well-studied correlate of lung pathophysiology), as spatial objects. In this work, we discuss the interrelatedness of the most common approaches for histogram-based optimization of hyperpolarized gas lung imaging segmentation and demonstrate how certain assumptions lead to suboptimal performance, particularly in terms of measurement precision. In contrast, we illustrate how a convolutional neural network is optimized (i.e., trained) directly within the image domain to leverage spatial information. This image-based optimization mitigates the problematic issues associated with histogram-based approaches and suggests a preferred future research direction. Importantly, we provide the entire processing and evaluation framework, including the newly reported deep learning functionality, as open-source through the well-known Advanced Normalization Tools ecosystem.Competing Interest StatementThe authors have declared no competing interest.Funding StatementSupport for the research reported in this work includes funding from the National Heart, Lung, and Blood Institute of the National Institutes of Health (R01HL133889).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Two image datasets were used in the preparation of this manuscript. The first image dataset comprised a retrospective collection which complied with the Health Insurance Portability and Accountability Act and was approved by the University of Virginia institutional review board (main reference number: 16215). The second image dataset is publicly available online at the Harvard Dataverse repository (https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/FCQWP1). Image acquisition was also IRB-approved (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6437021/).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe University of Virginia imaging data used for the evaluation is available upon request and through a data sharing agreement. In addition to the citation providing the online location of the original He 2019 Dataverse data, a header-modified version of these data is available in the GitHub repository associated with this manuscript. Additional evaluation plots are also available at this location. https://github.com/ntustison/Histograms