Abstract
Clinical positron emission tomography (PET) research is costly and entails exposing participants to radioactivity. Researchers should therefore aim to include just the number of subjects needed to fulfill the purpose of the study. In this tutorial we show how to apply sequential Bayes Factor testing in order to stop the recruitment of subjects in a clinical PET study as soon as enough data have been collected to make a conclusion. By using simulations, we demonstrate that it is possible to stop a study early, while keeping the number of erroneous conclusions low. We then apply sequential Bayes Factor testing to a real PET data set and show that it is possible to obtain support in favor of an effect while simultaneously reducing the sample size with 30%. Using this procedure allows researchers to reduce expense and radioactivity exposure for a range of effect sizes relevant for PET research.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
PPS was supported by the Swedish Society for Medical Research and the Lundbeck Foundation.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Study uses simulated or historical data
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Fixed typo in footnote, deleted duplicate references, changed wording from "inconclusive trials" to "inconclusive stopping outcomes".
3 The Bayes Factor is also known as the “predictive updating factor” of Bayes Theorem. It is what updates the prior odds of two competing hypotheses into posterior odds after seeing the observed data, and hence describes the relative “predictive adequacy” of the hypotheses. Assuming that H0 and H1 have equal prior probability (P(H1) = P(H0) = 0.5), then a BF of 3 means that after conducting the study, H1 is 3 times more likely than H0. This corresponds to a posterior probability of 75% for H1 and 25% for H0 (Kass and Raftery 1995). Although posterior odds are the natural extension of the BF, researchers tend to only report the BF as a stand-alone metric for assessing different hypotheses, due to the inherent subjective nature of specifying prior odds.
Data Availability
The data code for reproducing the results, tables and figures in this article can be found at https://github.com/pontusps/Early_stopping_in_PET.