Abstract
Importance We developed a model predicting the probability of success (PoS) for single planned or ongoing PhIII trials based on information available at trial initiation. Such a model is highly relevant for study sponsors to capture risk and opportunity on a trial-to-trial basis through trial optimization, and for investors to select drugs whose trial design match their investment strategy.
Objectives To predict the outcome of planned or ongoing PhIII trials in oncology, given publicly available prior information
Design, Setting, Participants Predictive modeling using publicly available data for 360 completed PhIII and 1240 PhII studies initiated between 2003 and 2012. Success and failure of PhIII studies were modeled using Bayesian logistic regression model.
Main Outcome Measures Predicted PoS of individual PhIII trials based on a Bayesian model calibrated on publicly available data translated into 16 composite scores. Those scores cover aspects such as trial design, indication, number of patients, phase II (PhII) study outcomes, experience of sponsor at time of trial initiation, and others.
Results The model allows to calculate the PoS distribution – including credible intervals – for a PhIII trial in oncology. The predictive performance was determined using an area under the receiver-operator curve (AUROC), resulting in an overall performance of 73%oPP (mean AUROC). We identified two key factors contributing to the predictive performance of the model: quality and strength of PhII data and experience of the sponsor at the time of study initiation.
Conclusion and Relevance We describe the generation and application of a statistical model predicting the PoS for individual PhIII trials in oncological indications with unprecedented predictive performance. Compared to other approaches, this is the first study generating a fully transparent model resulting in trial-specific PoS distributions. Moreover, we have shown that qualitative concepts such as PhII knowledge or sponsor R&D strength can be captured in quantitative scores and that these scores have a high predictive power.
Question What is the probability of success (PoS) for single phase III (PhII)I trials in oncology?
Findings We developed a model allowing to predict the PoS of single PhIII trials in oncology with a predictive performance of 73%PP and demonstrated that qualitative factors such as strength of PhII knowledge and sponsor R&D strength can be captured in quantitative scores that have significant predictive power.
Meaning The model can help study sponsors to analyze and amend planned clinical trials, and investors to choose where to invest best.
Competing Interest Statement
Conflict of Interest: No conflicts of interest are declared for JSM, PvB, MK. SH, LR and MT have personal investments in several biotechnology companies. SH is Senior Director of Corporate Strategy at HotSpot Therapeutics Inc. and general manager of Hegge Holding UG. JSM is co-founder of AskBy GmbH.
Funding Statement
No funding bodies had any role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The authors were personally salaried by their institutions during the period of writing (though no specific salary was set aside or given for the writing of this paper).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
No Institutional Review Board was required for data presented in this document.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
All data used to create this document are referenced and available at links below.
