Article Text

Download PDFPDF

Rare adverse events in clinical trials: understanding the rule of three
  1. Igho J Onakpoya
  1. Nuffield Department of Primary Care Health Sciences, University of Oxford, Centre for Evidence-Based Medicine, Oxford, UK
  1. Correspondence to Dr Igho J Onakpoya, Nuffield Department of Primary Care Health Sciences, University of Oxford, Centre for Evidence-Based Medicine, Oxford OX2 6GG, UK; igho.onakpoya{at}phc.ox.ac.uk

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Investigators should report rare and very rare adverse events in clinical trials. Even though they may not give a signal in any single trial, a meta-analysis could reveal potentially important drug–adverse event associations that might require further verification. Data from a meta-analysis of such rare events can shorten the time to decision-making by regulatory agencies and/or drug manufacturers, especially in cases where the reported harms are severe.

The benefit-harm profiles of new medicines are usually not fully known at the time of regulatory approval. This is because most trials are powered to detect benefits but not adverse events and also because adverse events are selectively reported1 or misinterpreted.2

One issue is that the number of trial subjects required in a trial to have a 95% chance of detecting an adverse drug reaction at low frequencies is large (table 1). If a new medication caused serious adverse reactions in 1 in 1000 cases, you need to study 3000 subjects (rule of three) in order to have a 95% chance of detecting even one case.

Table 1

The numbers of patients one would need to observe to have a 95% chance of detecting one, two or three cases of an adverse reaction at a given incidence of the reaction

The rule of three means that you need three times as many subjects to observe an event when you assume that the adverse event of interest does not normally occur in the absence of the medication.

Most medicines, however, are marketed on the basis of studies in relatively few subjects. Uncommon or rare events are therefore unlikely to be discovered before marketing. This is why postmarketing surveillance is so important.3

Adverse events with frequencies less than 2%, or in some cases less than 5%, are not always reported in clinical trials, even if they are collected, and even though such events could have serious clinical implications.

Several approaches for statistically combining data on rare adverse events have been described in the literature.4–6 If trial investigators report data on rare and very rare adverse events, the information from several trials can be combined to provide estimates that will help determine whether such events (even though rare in individual trials) warrant further investigation.

Acknowledgments

The author would like to acknowledge Jeffrey K Aronson and Rafael Perera for their helpful discussions and input.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.

Footnotes

  • Contributors IJO was involved with the conceptualisation and writing of the manuscript.

  • Competing interests None declared.

  • Provenance and peer review Commissioned; internally peer reviewed.