RT Journal Article SR Electronic T1 Dynamic methods for ongoing assessment of site-level risk in risk-based monitoring of clinical trials: a scoping review JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2020.04.01.20049627 DO 10.1101/2020.04.01.20049627 A1 William J Cragg A1 Caroline Hurley A1 Victoria Yorke-Edwards A1 Sally P Stenning YR 2020 UL http://medrxiv.org/content/early/2020/04/06/2020.04.01.20049627.abstract AB Background/Aims It is increasingly recognised that reliance on frequent site visits for monitoring clinical trials is inefficient. Regulators and trialists have in recent years encouraged more risk-based monitoring. Risk assessment should take place before a trial begins in order to define the overarching monitoring strategy. It can also be done on an ongoing basis, in order to target sites for monitoring activity. Various methods have been proposed for such prioritisation, often using terms like ‘central statistical monitoring’, ‘triggered monitoring’ or, as in ICH Good Clinical Practice guidance, ‘targeted on-site monitoring’. We conducted a scoping review to identify such methods, to establish if any published methods were supported by adequate evidence to allow wider implementation, and to point the way to future developments in this field of research.Methods We used 7 publication databases, 2 sets of methodological conference abstracts and an internet search engine to look for methods for using centrally held trial data to assess site conduct during a trial. We included only reports in English, and excluded reports published before 1996 and reports not directly relevant to our research question. We used reference and citation searches to find additional relevant reports. We extracted data using a pre- defined template. We contacted authors to request additional information about included reports and to check whether reports might be eligible.Results We included 30 reports in our final dataset, of which 21 were peer-reviewed publications. 20 reports described central statistical monitoring methods (of which 7 focussed on detection of fraud or misconduct) and 9 described triggered monitoring methods. 21 reports included some assessment of their methods’ effectiveness. Most commonly this involved exploring the methods’ characteristics using real trial data with no known integrity issues. Of the 21 with some effectiveness assessment, most presented limited or no information about whether or not concerns identified through central monitoring constituted meaningful problems. Some reports commented on cost savings from reduced on-site monitoring, but none gave detailed costings for the development and maintenance of central monitoring methods themselves.Conclusions Our review identified various proposed methods, some of which could be combined within the same trial. The apparent emphasis on fraud detection may not be proportionate in all trial settings. Although some methods have self-justifying benefits for data cleaning activity, many have limitations that may currently prevent their routine use for targeting trial monitoring activity. The implementation costs, or uncertainty about these, may also be a barrier. We make recommendations for how the evidence-base supporting these methods could be improved.Competing Interest StatementSS and WC are part of the TEMPER study team, one of the studies included in the final results of this paper. CH and VYE declare no conflict of interest.Funding StatementThis work was supported by the MRC London Hub for Trial Methodology Research (MC_UU_12023/24). The idea for this work arose from the TEMPER study, which was funded by a grant from Cancer Research UK (C1495/A13305).Author DeclarationsAll relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.YesAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data supporting this work are available on reasonable request. Please contact the corresponding author in the first instance: w.cragg{at}leeds.ac.uk.