Elsevier

NeuroImage

Volume 123, December 2015, Pages 212-228
NeuroImage

Impact of the resolution of brain parcels on connectome-wide association studies in fMRI

https://doi.org/10.1016/j.neuroimage.2015.07.071Get rights and content

Highlights

  • The FDR is controlled in GLM-connectome analysis with a single brain parcellation.

  • Replicating a GLM with multiresolution brain parcels can inflate the overall FDR.

  • A new omnibus test for multiresolution GLM-connectome analysis.

  • Simulation show increased GLM sensitivity using less than 50 brain parcels.

  • 30 brain parcels summarized well GLM effects in three real datasets.

Abstract

A recent trend in functional magnetic resonance imaging is to test for association of clinical disorders with every possible connection between selected brain parcels. We investigated the impact of the resolution of functional brain parcels, ranging from large-scale networks to local regions, on a mass univariate general linear model (GLM) of connectomes. For each resolution taken independently, the Benjamini–Hochberg procedure controlled the false-discovery rate (FDR) at nominal level on realistic simulations. However, the FDR for tests pooled across all resolutions could be inflated compared to the FDR within resolution. This inflation was severe in the presence of no or weak effects, but became negligible for strong effects. We thus developed an omnibus test to establish the overall presence of true discoveries across all resolutions. Although not a guarantee to control the FDR across resolutions, the omnibus test may be used for descriptive analysis of the impact of resolution on a GLM analysis, in complement to a primary analysis at a predefined single resolution. On three real datasets with significant omnibus test (schizophrenia, congenital blindness, motor practice), markedly higher rate of discovery were obtained at low resolutions, below 50, in line with simulations showing increase in sensitivity at such resolutions. This increase in discovery rate came at the cost of a lower ability to localize effects, as low resolution parcels merged many different brain regions together. However, with 30 or more parcels, the statistical effect maps were biologically plausible and very consistent across resolutions. These results show that resolution is a key parameter for GLM-connectome analysis with FDR control, and that a functional brain parcellation with 30 to 50 parcels may lead to an accurate summary of full connectome effects with good sensitivity in many situations.

Introduction

Brain connectivity in resting-state functional magnetic resonance imaging (fMRI) has been found to be associated with a wide variety of clinical disorders (Fox and Greicius, 2010, Castellanos et al., 2013, Barkhof et al., 2014). Rather than focusing on a limited set of a priori regions of interest, a recent trend is to perform statistical tests of association across the whole connectome, i.e. at every possible brain connection (Shehzad et al., 2014). Such connectome-wide association studies (CWAS) critically depend on the choice of the brain parcels that are used to estimate the connections. Analyses have been performed at different resolutions in the literature (Meskaldji et al., 2013), e.g. voxels (Shehzad et al., 2014), regions (Wang et al., 2007), or distributed networks (Jafri et al., 2008, Marrelec et al., 2008). The main objective of this work was to study the impact of the spatial resolution on the results of a CWAS.

The mass-univariate approach to CWAS (Worsley et al., 1998) consists of independently estimating a GLM at every connection. In the GLM, a series of equations are solved to find a linear mixture of explanatory variables (called covariates) that best fit the connectivity values observed across the many subjects. A p value is generated for each connection to quantify the probability that the estimated strength of association between this connection and a covariate of interest could have arisen randomly in the absence of a true association (Worsley and Friston, 1995). The significance level of each test needs to be corrected for the total number of tests, i.e. the number of brain connections, using for example random field theory (Worsley et al., 1998) or FDR (Benjamini and Hochberg, 1995). Correction for multiple comparisons however generally comes at the cost of a sharp decrease in sensitivity.

A straightforward way to mitigate the impact of multiple comparisons on statistical power is to reduce the number of brain parcels. For example, the AAL template (Tzourio-Mazoyer et al., 2002) includes 116 brain parcels based on anatomical landmarks. Data-driven algorithms can also generate functional brain parcels (Bellec et al., 2006, Thirion et al., 2006, Thirion et al., 2014, Craddock et al., 2012, Blumensath et al., 2013, Gordon et al., 2014). Few investigators have examined how resolution impacts the results of a CWAS. Abou Elseoud et al. (2011) explored the impact of the number of components in a dual-regression independent component analysis on the difference between patients suffering from non-medicated seasonal affective disorder and normal healthy controls. The authors concluded that the number of significant findings was maximized at resolution 45 (in this case, 45 independent components). The impact of the number of brain parcels was also investigated using spatially-constrained spectral clustering (Craddock et al., 2012) at much higher resolutions (from 50 to 3000 +) by Shehzad et al. (2014). The authors concluded that the association between resting-state connectivity and intelligence quotient was consistent across resolutions. It should be noted that, in the above-mentioned studies (Abou Elseoud et al., 2011, Shehzad et al., 2014), the authors did not investigate the implications that the replication of statistical tests at multiple resolutions may have in terms of the control of false positives. We are thus not currently aware of a valid statistical framework to examine the results of a CWAS with data-driven brain parcellations at multiple resolutions.

In this paper, we investigated empirically the impact of the number of brain parcels (resolution) on a mass univariate GLM analysis of connectomes (GLM-connectome). Our first objective was to empirically assess if the Benjamini–Hochberg procedure (Benjamini and Hochberg, 1995) controlled appropriately the FDR with a single brain parcellation, and generated biologically plausible results. Our second objective was to assess if repeating a GLM-connectome analysis independently using multiple parcellations at different resolutions would inflate the overall FDR, pooling tests across all resolutions. Anticipating a lack of control in the absence of any true association, we developed an omnibus test checking for the overall presence of significant associations across all resolutions. Our third objective was to use the omnibus test to evaluate how the resolution impacted the rate of discovery in a GLM analysis, and if the associations derived with the GLM would be consistent across resolutions. We conducted a series of experiments involving both simulated and real datasets to address these three objectives, which have been summarized, along with the main findings, in Table 1.

Section snippets

Functional connectome

The first step to build a connectome is to select a parcellation of the brain, with R parcels. In this work, we relied on a “Bootstrap Analysis of Stable Clusters” (BASC), which can identify consistent functional parcels for a group of subjects (Bellec et al., 2010), using a hierarchical cluster with Ward's criterion both at the individual and the group levels. The functional parcels can be generated at any arbitrary resolution (within the range of the fMRI resolution), and we considered only

Data-generating procedure

We started by simple simulations of independent tests, to assess to which extent the hypothesis of Efron (2008) was robust to different scenarios, and if the omnibus test would systematically ensure that the FDR across resolutions would be well controlled. A number K of test resolutions were generated independently, each one composed of Lk tests, k = 1,…,K. Each resolution included a set proportion of true non-null hypotheses π1, identical for all resolutions. If π1Lk was not an integer, the

Data-generating procedure

We designed a simulation framework for multiresolution GLM-connectome analysis in the presence of dependencies between tests, both within resolution and across resolutions. To ensure that these dependencies would be as realistic as possible, semi-synthetic datasets were generated starting from a large real sample (Cambridge) released as part of the 1000 functional connectome project6 (Biswal et al., 2010). This sample (Liu et al., 2009

Participants

We evaluated the GLM-connectome on three real datasets: (1) a study (SCHIZO) comparing patients suffering from schizophrenia with healthy control subjects; (2) a study (BLIND) on patients suffering of congenital blindness, compared to sighted controls; and (3) a study (MOTOR) where resting-state data connectivity was compared before and after learning of a motor task. The SCHIZO dataset was contributed by the Center for Biomedical Research Excellence (COBRE) to the 1000 functional connectome

Specificity in multiresolution analysis

This work investigated empirically how the resolution impacts GLM analyses on connectomes, in particular in terms of specificity. We confirmed on realistic simulations the validity of a FDR control using the BH procedure at a single resolution. On three real datasets, there was no sign of substantial departure from the assumptions of a basic parametric GLM. The censoring of time frames with excessive motion will still very likely introduce some departure from the homoscedasticity assumption,

Conclusion

Our overall conclusion is that the GLM analysis of connectomes with control of the FDR using the BH procedure is statistically valid when used at a single resolution, and has the potential to identify biologically plausible associations in a variety of experimental conditions. Caution should be exercised when replicating a GLM-connectome analysis at different resolutions, as the FDR over the tests combined across all resolutions may depart from the FDR within resolution. We proposed a valid

Acknowledgments

Parts of this work were presented at the 2012 and 2013 annual meetings of the organization for human brain mapping, as well as the International Conference on Resting-State Connectivity 2012 (Magdeburg). The authors are grateful to the members of the 1000 functional connectome consortium for publicly releasing the “Cambridge” and “COBRE” data samples, as well as Dr Shehzad for valuable feedback. The computational resources used to perform the data analysis were provided by Compute Canada13

References (54)

  • A. Abou Elseoud et al.

    Group-ICA model order highlights patterns of functional brain connectivity

    Front. Syst. Neurosci.

    (2011)
  • Y. Ad-Dab'bagh et al.

    The CIVET image-processing environment: a fully automated comprehensive pipeline for anatomical neuroimaging research

  • N.B. Albert et al.

    The resting human brain and motor learning

    Curr. Biol.

    (2009)
  • G. Albouy et al.

    Maintaining vs. enhancing motor sequence memories: respective roles of striatal and hippocampal systems

    NeuroImage

    (2015)
  • C.W. Anderson

    Quantitative Methods for Current Environmental Issues

    (2002)
  • A. Anticevic et al.

    Characterizing thalamo-cortical disturbances in schizophrenia and bipolar illness

    Cereb. Cortex

    (2014)
  • F. Barkhof et al.

    Resting-state functional MR imaging: a new window to the brain

    Radiology

    (2014)
  • P. Bellec

    Mining the hierarchy of resting-state brain networks: selection of representative clusters in a multiscale structure

  • P. Bellec et al.

    Identification of large-scale networks in the brain using fMRI

    NeuroImage

    (2006)
  • P. Bellec et al.

    Multi-level bootstrap analysis of stable clusters in resting-state fMRI

    NeuroImage

    (2010)
  • P. Bellec et al.

    The pipeline system for Octave and Matlab (PSOM): a lightweight scripting framework and execution engine for scientific workflows

    Front. Neuroinforma.

    (2012)
  • P. Bellec et al.

    A neuroimaging analysis kit for Matlab and Octave

  • Y. Benjamini et al.

    Controlling the false-discovery rate: a practical and powerful approach to multiple testing

    J. R. Stat. Soc. Ser. B

    (1995)
  • Y. Benjamini et al.

    The control of the false discovery rate in multiple testing under dependency

    Ann. Stat.

    (2001)
  • B.B. Biswal et al.

    Toward discovery science of human brain function

    Proc. Natl. Acad. Sci. U. S. A.

    (2010)
  • T. Blumensath et al.

    Spatially constrained hierarchical parcellation of the brain with resting-state fMRI

    NeuroImage

    (2013)
  • V.D. Calhoun et al.

    Functional brain networks in schizophrenia: a review

    Front. Hum. Neurosci.

    (2009)
  • F.X. Castellanos et al.

    Clinical applications of the functional connectome

    NeuroImage

    (2013)
  • O. Collignon et al.

    Functional specialization for auditory-spatial processing in the occipital cortex of congenitally blind humans

    Proc. Natl. Acad. Sci. U. S. A.

    (2011)
  • D.L. Collins et al.

    Animal: validation and applications of nonlinear registration-based segmentation

    Int. J. Pattern Recognit. Artif. Intell.

    (1997)
  • R.C. Craddock et al.

    A whole brain fMRI atlas generated via spatially constrained spectral clustering

    Hum. Brain Mapp.

    (2012)
  • B. Efron

    Simultaneous inference: when should hypothesis testing problems be combined?

    Ann. Appl. Stat.

    (2008)
  • V. Fonov et al.

    Unbiased average age-appropriate atlases for pediatric studies

    NeuroImage

    (2011)
  • A. Fornito et al.

    Schizophrenia, neuroimaging and connectomics

    NeuroImage

    (2012)
  • M.D. Fox et al.

    Clinical applications of resting state functional connectivity

    Front. Syst. Neurosci.

    (2010)
  • F. Giove et al.

    Images-based suppression of unwanted global signals in resting-state functional connectivity studies

    Magn. Reson. Imaging

    (2009)
  • E.M. Gordon et al.

    Generation and evaluation of a cortical area parcellation from resting-state correlations

    Cereb. Cortex

    (2014)
  • Cited by (35)

    • Using connectomics for predictive assessment of brain parcellations

      2021, NeuroImage
      Citation Excerpt :

      Finally, we also observed that, for the SC and intra-subject FC predictions, accounting for the cortical surface structure using Geodesic distances generally performed better than the corresponding use of Euclidean distances. The recent popularity of data-driven in-vivo parcellation approaches, as exemplified by Behrens et al. (2003a); Bellec et al. (2015, 2006); Blumensath et al. (2013); Clos et al. (2013); Craddock et al. (2013); Eickhoff et al. (2015); Fan et al. (2016); Glasser et al. (2016); Shen et al. (2013); Thirion et al. (2014); Yeo et al. (2011), highlights the growing demand for alternatives to conventional atlases, e.g. Desikan et al. (2006); Destrieux et al. (2010); Lancaster et al. (2000); Nieuwenhuys (2013); Nieuwenhuys et al. (2015); Tzourio-Mazoyer et al. (2002). However, it is necessary to recall that such data-driven methods are primarily uni-modal (though with some exceptions, e.g. Fan et al. (2016); Glasser et al. (2016); Parisot et al. (2017)), and as such their resultant parcellations do not conform to the traditional definition of cortical areas, where within-area homogeneity and inter-area uniqueness are required to be congruent across the three commonly-employed modalities of structure, function and connectivity Amunts and Zilles (2015); Felleman and Van Essen (1991); Van Essen et al. (1992).

    • Brain graph super-resolution for boosting neurological disorder diagnosis using unsupervised multi-topology connectional brain template learning

      2020, Medical Image Analysis
      Citation Excerpt :

      This process has two severe limitations: (1) it is very time consuming (it can last up to a few hours when using refined deformable registration), and (2) it is sensitive to the deployed pre-processing methods including registration, atlas-to-image label propagation, which might preclude the comparison of healthy and disordered brain connectomes produced using different MRI pre-processing pipelines. In fact, parcellation methods use predefined coarsely parcellated brain atlases such as Automated Anatomical Labelling (AAL) with 90 ROIs, which define the size or resolution of the resulting brain connectomes (Bellec et al., 2015). For instance, the commonly used statistical parametric mapping (SPM) software (Ashburner, 2012) for generating functional connectomes performs automated anatomical parcellation of brain MR images.

    View all citing articles on Scopus
    View full text