Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Early Stopping in Experimentation with Real-time Functional Magnetic Resonance Imaging Using a Modified Sequential Probability Ratio Test

Sarah J. A. Carr, Weicong Chen, Jeremy Fondran, Harry Friel, Javier Sanchez-Gonzalez, Jing Zhang, Curtis Tatsuoka
doi: https://doi.org/10.1101/2021.01.15.21249886
Sarah J. A. Carr
1Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, UK
2Department of Neurology, Case Western Reserve University, Cleveland, OH, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Weicong Chen
3Department of Computer and Data Sciences, Case Western Reserve University, Cleveland, OH, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jeremy Fondran
4Department of Population and Quantitative Health Sciences, Case Western Reserve University, Cleveland, OH, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Harry Friel
5Philips Healthcare, Highland Heights, OH, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Javier Sanchez-Gonzalez
6Philips Healthcare, Madrid, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jing Zhang
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Curtis Tatsuoka
4Department of Population and Quantitative Health Sciences, Case Western Reserve University, Cleveland, OH, USA
2Department of Neurology, Case Western Reserve University, Cleveland, OH, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: cmt66@case.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Introduction Functional magnetic resonance imaging (fMRI) often involves long scanning durations to ensure the associated brain activity can be detected. However, excessive experimentation can lead to many undesirable effects, such as from learning and/or fatigue effects, discomfort for the subject, excessive motion artifacts and loss of sustained attention on task. Overly long experimentation can thus have a detrimental effect on signal quality and accurate voxel activation detection. Here, we propose dynamic experimentation with real-time fMRI using a novel statistically-driven approach that invokes early stopping when sufficient statistical evidence for assessing the task-related activation is observed.

Methods Voxel-level sequential probability ratio test (SPRT) statistics based on general linear models (GLMs) were implemented on fMRI scans of a mathematical 1-back task from 12 healthy teenage subjects and 11 teenage subjects born extremely preterm (EPT). This approach is based on likelihood ratios and allows for systematic early stopping based on statistical error thresholds. We adopt a two-stage estimation approach that allows for accurate estimates of error variance. Early stopping performance is reported for different first stage lengths, and activation results are compared with full durations. Finally, group comparisons are conducted with both early stopped and full duration scan data. Numerical parallelization was employed to facilitate completion of computations involving a new scan within every repetition time (TR).

Results Use of SPRT demonstrates the feasibility and efficiency gains of automated early stopping, with comparable activation detection as with full protocols. Dynamic stopping of stimulus administration was achieved in around half of subjects, with typical time savings between 33 - 66% (4 – 8 minutes on a 12 minute scan). A group analysis produced similar patterns of activity for control subjects between early stopping and full duration scans. The EPT group, individually, demonstrated more variability in location and extent of the activations compared to the normal term control group. This was apparent in the EPT group results, reflected by fewer and smaller clusters.

Conclusion A systematic statistical approach for early stopping with real-time fMRI experimentation has been implemented. This dynamic approach has promise for reducing subject burden and fatigue effects.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This study was supported by Phillips Healthcare and the National Science Foundation (Award number: 1561716).

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

UH Hospitals Cleveland Medical Center IRB

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • - Author list updated. - Methods section revised and expanded for clarity. - Results revised and updated with further analyses and explanations added. - Discussion updated to reflect results. - Supplemental file added.

Data Availability

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted March 12, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Early Stopping in Experimentation with Real-time Functional Magnetic Resonance Imaging Using a Modified Sequential Probability Ratio Test
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Early Stopping in Experimentation with Real-time Functional Magnetic Resonance Imaging Using a Modified Sequential Probability Ratio Test
Sarah J. A. Carr, Weicong Chen, Jeremy Fondran, Harry Friel, Javier Sanchez-Gonzalez, Jing Zhang, Curtis Tatsuoka
medRxiv 2021.01.15.21249886; doi: https://doi.org/10.1101/2021.01.15.21249886
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
Early Stopping in Experimentation with Real-time Functional Magnetic Resonance Imaging Using a Modified Sequential Probability Ratio Test
Sarah J. A. Carr, Weicong Chen, Jeremy Fondran, Harry Friel, Javier Sanchez-Gonzalez, Jing Zhang, Curtis Tatsuoka
medRxiv 2021.01.15.21249886; doi: https://doi.org/10.1101/2021.01.15.21249886

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Radiology and Imaging
Subject Areas
All Articles
  • Addiction Medicine (76)
  • Allergy and Immunology (196)
  • Anesthesia (54)
  • Cardiovascular Medicine (489)
  • Dentistry and Oral Medicine (90)
  • Dermatology (56)
  • Emergency Medicine (168)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (211)
  • Epidemiology (5689)
  • Forensic Medicine (3)
  • Gastroenterology (216)
  • Genetic and Genomic Medicine (868)
  • Geriatric Medicine (88)
  • Health Economics (232)
  • Health Informatics (762)
  • Health Policy (392)
  • Health Systems and Quality Improvement (254)
  • Hematology (105)
  • HIV/AIDS (182)
  • Infectious Diseases (except HIV/AIDS) (6488)
  • Intensive Care and Critical Care Medicine (391)
  • Medical Education (117)
  • Medical Ethics (28)
  • Nephrology (93)
  • Neurology (850)
  • Nursing (44)
  • Nutrition (141)
  • Obstetrics and Gynecology (163)
  • Occupational and Environmental Health (262)
  • Oncology (514)
  • Ophthalmology (163)
  • Orthopedics (44)
  • Otolaryngology (107)
  • Pain Medicine (48)
  • Palliative Medicine (21)
  • Pathology (149)
  • Pediatrics (250)
  • Pharmacology and Therapeutics (146)
  • Primary Care Research (114)
  • Psychiatry and Clinical Psychology (969)
  • Public and Global Health (2231)
  • Radiology and Imaging (377)
  • Rehabilitation Medicine and Physical Therapy (174)
  • Respiratory Medicine (312)
  • Rheumatology (109)
  • Sexual and Reproductive Health (81)
  • Sports Medicine (82)
  • Surgery (118)
  • Toxicology (25)
  • Transplantation (34)
  • Urology (42)