Abstract
Machine learning (ML) has been applied to develop magnetic resonance imaging (MRI)-based diagnostic classifiers for attention-deficit/hyperactivity disorder (ADHD). This systematic review examines this literature to clarify its clinical significance and to assess the implications of the various analytic methods applied. We found that, although most of studies reported the classification accuracies, they varied in choice of MRI modalities, ML models, cross-validation and testing methods, and sample sizes. We found that the accuracies of cross-validation methods inflated the performance estimation compared with those of a held-out test, compromising the model generalizability. Test accuracies have increased with publication year but were not associated with training sample sizes. Improved test accuracy over time was likely due to the use of better ML methods along with strategies to deal with data imbalances. Ultimately, large multi-modal imaging datasets, and potentially the combination with other types of data, like cognitive data and/or genetics, will be essential to achieve the goal of developing clinically useful imaging classification tools for ADHD in the future.
- attention deficit hyperactivity disorder
- biomarkers
- classification
- machine learning
- MRI
Competing Interest Statement
Dr. Franke has received educational speaking fees from Medice. In the past year, Dr. Faraone received income, potential income, travel expenses continuing education support and/or research support from Takeda, OnDosis, Tris, Otsuka, Arbor, Ironshore, Rhodes, Akili Interactive Labs, Sunovion, Supernus and Genomind. With his institution, he has US patent US20130217707 A1 for the use of sodium-hydrogen exchange inhibitors in the treatment of ADHD. He also receives royalties from books published by Guilford Press(Straight Talk about Your Child's Mental Health), Oxford University Press(Schizophrenia, The Facts) and Elsevier (ADHD: Non-Pharmacologic Interventions). He is Program Director of www.adhdinadults.com.
Funding Statement
Dr. Zhang-James is supported by the European Union's Seventh Framework Programme for research, technological development and demonstration (grant number 602805) and the European Union's Horizon 2020 research and innovation programme (grant number 667302). Dr. Hoogman is supported by a personal Veni grant from of the Netherlands Organization for Scientific Research (NWO, grant number 91619115).Dr. Franke is supported by a personal Vici grant (grant number 016-130-669) from the Netherlands Organization for Scientific Research (NWO). Dr. Faraone is supported by the European Union's Seventh Framework Programme for research, technological development and demonstration (grant number 602805), the European Union's Horizon 2020 research and innovation programme (grant number 667302 & 728018) and United States National Institute of Mental Health (NIMH, grant numbers 5R01MH101519 and U01 MH109536-01).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
NA
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Declaration of interest Drs Zhang-James and Hoogman declare no conflict of interest.
Dr. Franke has received educational speaking fees from Medice.
In the past year, Dr. Faraone received income, potential income, travel expenses continuing education support and/or research support from Takeda, OnDosis, Tris, Otsuka, Arbor, Ironshore, Rhodes, Akili Interactive Labs, Sunovion, Supernus and Genomind. With his institution, he has US patent US20130217707 A1 for the use of sodium-hydrogen exchange inhibitors in the treatment of ADHD. He also receives royalties from books published by Guilford Press: Straight Talk about Your Child’s Mental Health, Oxford University Press: Schizophrenia: The Facts and Elsevier: ADHD: Non-Pharmacologic Interventions. He is Program Director of www.adhdinadults.com.
Data Availability
NA