Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Multivariate brain-based dimensions of child psychiatric problems: degrees of generalizability

Bing Xu, Lorenza Dall’Aglio, John Flournoy, Gerda Bortsova, Brenden Tervo-Clemmens, Paul Collins, Marleen de Bruijne, Monica Luciana, Andre Marquand, Hao Wang, Henning Tiemeier, Ryan L. Muetzel
doi: https://doi.org/10.1101/2023.03.12.23287158
Bing Xu
1Department of Child and Adolescent Psychology and Psychiatry, Erasmus MC University Medical Center Rotterdam-Sophia Children’s Hospital, Rotterdam, The Netherlands
2The Generation R Study Group, Erasmus MC University Medical Center Rotterdam, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lorenza Dall’Aglio
1Department of Child and Adolescent Psychology and Psychiatry, Erasmus MC University Medical Center Rotterdam-Sophia Children’s Hospital, Rotterdam, The Netherlands
2The Generation R Study Group, Erasmus MC University Medical Center Rotterdam, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John Flournoy
3Department of Psychology, Harvard University, Cambridge, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gerda Bortsova
4Department of Radiology and Nuclear Medicine, Biomedical Imaging Group Rotterdam, Erasmus MC University Medical Center Rotterdam, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brenden Tervo-Clemmens
5Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul Collins
6Department of Psychology, University of Minnesota, Minneapolis, MN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marleen de Bruijne
4Department of Radiology and Nuclear Medicine, Biomedical Imaging Group Rotterdam, Erasmus MC University Medical Center Rotterdam, Rotterdam, The Netherlands
7Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Monica Luciana
6Department of Psychology, University of Minnesota, Minneapolis, MN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andre Marquand
8Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
9Radboud University Medical Center, Nijmegen, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hao Wang
10Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Henning Tiemeier
1Department of Child and Adolescent Psychology and Psychiatry, Erasmus MC University Medical Center Rotterdam-Sophia Children’s Hospital, Rotterdam, The Netherlands
11Department of Social and Behavioral Sciences, Harvard T. Chan School of Public Health, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: tiemeier@hsph.harvard.edu
Ryan L. Muetzel
1Department of Child and Adolescent Psychology and Psychiatry, Erasmus MC University Medical Center Rotterdam-Sophia Children’s Hospital, Rotterdam, The Netherlands
12Department of Radiology and Nuclear Medicine, Erasmus MC University Medical Center Rotterdam, Rotterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Multivariate machine learning techniques are a promising set of tools for identifying complex brain-behavior associations. However, failure to replicate results from these methods across samples has hampered their clinical relevance. This study aimed to delineate dimensions of brain functional connectivity that are associated with child psychiatric symptoms in two large and independent cohorts: the Adolescent Brain Cognitive Development (ABCD) Study and the Generation R Study (total n=8,605). Using sparse canonical correlations analysis, we identified three brain-behavior dimensions in ABCD: attention problems, aggression and rule-breaking behaviors, and withdrawn behaviors. Importantly, out-of-sample generalizability of these dimensions was consistently observed in ABCD, suggesting robust multivariate brain-behavior associations. Despite this, out-of-study generalizability in Generation R was limited. These results highlight that the degree of generalizability can vary depending on the external validation methods employed as well as the datasets used, emphasizing that biomarkers will remain elusive until models generalize better in true external settings.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

Data used in the preparation of this article were obtained from the Adolescent Brain Cognitive Development (ABCD) Study (https://abcdstudy.org), held in the NIMH Data Archive (NDA). This is a multisite, longitudinal study designed to recruit more than 10,000 children age 9-10 and follow them over 10 years into early adulthood. The ABCD Study is supported by the National Institutes of Health and additional federal partners under award numbers U01DA041048, U01DA050989, U01DA051016, U01DA041022, U01DA051018, U01DA051037, U01DA050987, U01DA041174, U01DA041106, U01DA041117, U01DA041028, U01DA041134, U01DA050988, U01DA051039, U01DA041156, U01DA041025, U01DA041120, U01DA051038, U01DA041148, U01DA041093, U01DA041089, U24DA041123, U24DA041147. A full list of supporters is available at https://abcdstudy.org/federal-partners.html. A listing of participating sites and a complete listing of the study investigators can be found at https://abcdstudy.org/consortium_members/. ABCD consortium investigators designed and implemented the study and/or provided data but did not necessarily participate in the analysis or writing of this report. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or ABCD consortium investigators. The Generation R Study is supported by Erasmus MC, Erasmus University Rotterdam, the Rotterdam Homecare Foundation, the Municipal Health Service Rotterdam area, the Stichting Trombosedienst & Artsenlaboratorium Rijnmond, the Netherlands Organization for Health Research and Development (ZonMw), and the Ministry of Health, Welfare and Sport. Neuroimaging data acquisition was funded by the European Community 7th Framework Program (FP7/2008-2013, 212652, Nutrimenthe). Netherlands Organization for Scientific Research (Exacte Wetenschappen) and SURFsara (Snellius Compute Cluster, www.surfsara.nl) supported the Supercomputing resources. Authors are supported by an NWO-VICI grant (NWO-ZonMW: 016.VICI.170.200 to HT) for HT, BX, and the Sophia Foundation S18-20, and Erasmus MC Fellowship for RLM.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

For the ABCD Study, ethical approval was received from the institutional review boards of the University of California (San Diego) and each ABCD site, adhering to their Institutional Review Board approved protocols, state regulations, and local resources. For the Generation R Study, ethical approval was obtained through the Medical Ethics Committee of Erasmus MC, University Medical Centre (Rotterdam). of each of the 21 data collection sites for ABCD, and the Medical Ethics Committee of Erasmus MC, University Medical Centre (Rotterdam) for GenR. Informed consent or assent has been received from the included participants.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

The ABCD data reported in this paper are openly available upon approval from the NDA Data Access Committee. The ABCD data came from ABCD collection 3165 (ABCD-BIDS Community Collection (ABCC), https://collection3165.readthedocs.io) and the Annual Release 4.0 (https://doi.org/ 10.15154/1523041). The Generation R datasets generated and/or analyzed during the current study may be made available upon request to the Director of the Generation R Study, Vincent Jaddoe (v.jaddoe@erasmusmc.nl), in accordance with the local, national, and European Union regulations.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted March 20, 2023.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Multivariate brain-based dimensions of child psychiatric problems: degrees of generalizability
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Multivariate brain-based dimensions of child psychiatric problems: degrees of generalizability
Bing Xu, Lorenza Dall’Aglio, John Flournoy, Gerda Bortsova, Brenden Tervo-Clemmens, Paul Collins, Marleen de Bruijne, Monica Luciana, Andre Marquand, Hao Wang, Henning Tiemeier, Ryan L. Muetzel
medRxiv 2023.03.12.23287158; doi: https://doi.org/10.1101/2023.03.12.23287158
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Multivariate brain-based dimensions of child psychiatric problems: degrees of generalizability
Bing Xu, Lorenza Dall’Aglio, John Flournoy, Gerda Bortsova, Brenden Tervo-Clemmens, Paul Collins, Marleen de Bruijne, Monica Luciana, Andre Marquand, Hao Wang, Henning Tiemeier, Ryan L. Muetzel
medRxiv 2023.03.12.23287158; doi: https://doi.org/10.1101/2023.03.12.23287158

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Psychiatry and Clinical Psychology
Subject Areas
All Articles
  • Addiction Medicine (269)
  • Allergy and Immunology (549)
  • Anesthesia (134)
  • Cardiovascular Medicine (1747)
  • Dentistry and Oral Medicine (238)
  • Dermatology (172)
  • Emergency Medicine (310)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (653)
  • Epidemiology (10780)
  • Forensic Medicine (8)
  • Gastroenterology (584)
  • Genetic and Genomic Medicine (2933)
  • Geriatric Medicine (286)
  • Health Economics (531)
  • Health Informatics (1918)
  • Health Policy (833)
  • Health Systems and Quality Improvement (743)
  • Hematology (290)
  • HIV/AIDS (627)
  • Infectious Diseases (except HIV/AIDS) (12496)
  • Intensive Care and Critical Care Medicine (684)
  • Medical Education (299)
  • Medical Ethics (86)
  • Nephrology (321)
  • Neurology (2780)
  • Nursing (150)
  • Nutrition (431)
  • Obstetrics and Gynecology (554)
  • Occupational and Environmental Health (597)
  • Oncology (1454)
  • Ophthalmology (440)
  • Orthopedics (172)
  • Otolaryngology (255)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (379)
  • Pediatrics (865)
  • Pharmacology and Therapeutics (362)
  • Primary Care Research (333)
  • Psychiatry and Clinical Psychology (2630)
  • Public and Global Health (5338)
  • Radiology and Imaging (1002)
  • Rehabilitation Medicine and Physical Therapy (594)
  • Respiratory Medicine (722)
  • Rheumatology (329)
  • Sexual and Reproductive Health (288)
  • Sports Medicine (278)
  • Surgery (327)
  • Toxicology (47)
  • Transplantation (149)
  • Urology (125)