PT - JOURNAL ARTICLE AU - Zhang-James, Yanli AU - Hoogman, Martine AU - Franke, Barbara AU - Faraone, Stephen V TI - Machine Learning And MRI-Based Diagnostic Models For ADHD: Are We There Yet? AID - 10.1101/2020.10.20.20216390 DP - 2020 Jan 01 TA - medRxiv PG - 2020.10.20.20216390 4099 - http://medrxiv.org/content/early/2020/10/23/2020.10.20.20216390.short 4100 - http://medrxiv.org/content/early/2020/10/23/2020.10.20.20216390.full AB - Machine learning (ML) has been applied to develop magnetic resonance imaging (MRI)-based diagnostic classifiers for attention-deficit/hyperactivity disorder (ADHD). This systematic review examines this literature to clarify its clinical significance and to assess the implications of the various analytic methods applied. We found that, although most of studies reported the classification accuracies, they varied in choice of MRI modalities, ML models, cross-validation and testing methods, and sample sizes. We found that the accuracies of cross-validation methods inflated the performance estimation compared with those of a held-out test, compromising the model generalizability. Test accuracies have increased with publication year but were not associated with training sample sizes. Improved test accuracy over time was likely due to the use of better ML methods along with strategies to deal with data imbalances. Ultimately, large multi-modal imaging datasets, and potentially the combination with other types of data, like cognitive data and/or genetics, will be essential to achieve the goal of developing clinically useful imaging classification tools for ADHD in the future.Competing Interest StatementDr. Franke has received educational speaking fees from Medice. In the past year, Dr. Faraone received income, potential income, travel expenses continuing education support and/or research support from Takeda, OnDosis, Tris, Otsuka, Arbor, Ironshore, Rhodes, Akili Interactive Labs, Sunovion, Supernus and Genomind. With his institution, he has US patent US20130217707 A1 for the use of sodium-hydrogen exchange inhibitors in the treatment of ADHD. He also receives royalties from books published by Guilford Press(Straight Talk about Your Child's Mental Health), Oxford University Press(Schizophrenia, The Facts) and Elsevier (ADHD: Non-Pharmacologic Interventions). He is Program Director of www.adhdinadults.com.Funding StatementDr. Zhang-James is supported by the European Union's Seventh Framework Programme for research, technological development and demonstration (grant number 602805) and the European Union's Horizon 2020 research and innovation programme (grant number 667302). Dr. Hoogman is supported by a personal Veni grant from of the Netherlands Organization for Scientific Research (NWO, grant number 91619115).Dr. Franke is supported by a personal Vici grant (grant number 016-130-669) from the Netherlands Organization for Scientific Research (NWO). Dr. Faraone is supported by the European Union's Seventh Framework Programme for research, technological development and demonstration (grant number 602805), the European Union's Horizon 2020 research and innovation programme (grant number 667302 & 728018) and United States National Institute of Mental Health (NIMH, grant numbers 5R01MH101519 and U01 MH109536-01). Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:NAAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesNA