RT Journal Article
SR Electronic
T1 Multiverse to inform neurological research: an example using recovery outcome of neglect
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2021.03.29.21254222
DO 10.1101/2021.03.29.21254222
A1 Margaret J Moore
A1 Nele Demeyere
YR 2021
UL http://medrxiv.org/content/early/2021/04/04/2021.03.29.21254222.abstract
AB Objective Multiverse analysis provides an ideal tool for understanding how inherent, yet ultimately arbitrary methodological choices impact the conclusions of individual studies. With this investigation we aimed to demonstrate the utility of multiverse analysis for evaluating generalisability and identifying potential sources of bias within studies employing neurological populations.Method Multiverse analysis was used to evaluate the robustness of the relationship between post-stroke visuospatial neglect and poor long term recovery outcome within a sample of 1113 (age =72.5, 45.1% female) stroke survivors. A total of 25,600 t-test comparisons were run across 400 different patient groups defined using various combinations of valid inclusion criteria based on lesion location, stroke type, assessment time, neglect impairment definition, and scoring criteria across 16 standardised outcome measures.Results Overall, 33.9% of conducted comparisons yielded significant results. 99.9% of these significant results fell below the null specification curve, indicating a highly robust relationship between neglect and poor recovery outcome. However, the strength of this effect was not constant across all comparison groups. Comparisons which included <100 participants, pre-selected patients based on lesion type, or failed to account for allocentric neglect impairment were found to yield average effect sizes which differed substantially. Similarly, average effect sizes differed across various outcome measures with the strongest average effect in comparisons involving an activities of daily living measure and the weakest in comparisons employing a depression subscale.Conclusions This investigation demonstrates the utility of multiverse analysis techniques for evaluating effect robustness and identifying potential sources of bias within neurological research.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialN/AFunding StatementThis work was funded by Stroke Association UK awards to ND (TSA2015_LECT02; TSA 2011/02) and MJM (SA PGF 18\100031).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This project represents a secondary analysis of longitudinal data collected as part of the: OCS-Tablet Cognitive Screening study (14/LO/0648),NRES Committee London - Camden & Islington, approved, 10/04/2014 OCS-Care study (12/WM/00335), NRES Committee West Midlands - Coventry & Warwickshire, approved, 23/09/2014 OCS-Recovery Study (18/SC/0550), South Central - Oxford C Research Ethics Committee, approved, 2/11/2018 All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data and code has been made openly available on the Open Science Framework (https://osf.io/vfnry/). https://osf.io/vfnry/ AbbreviationsOCSOxford Cognitive ScreenNIHSSNational Institute of Health Stroke ScreenSISStroke Impact ScaleADLActivities of Daily LivingHADSHospital Anxiety and Depression Scale