A third of systematic reviews changed or did not specify the primary outcome: a PROSPERO register study

Andrea C Tricco; Elise Cogo; Matthew J Page; Julie Polisena; Alison Booth; Kerry Dwan; Heather MacDonald; Tammy J Clifford; Lesley A Stewart; Sharon E Straus; David Moher

doi:10.1016/j.jclinepi.2016.03.025

A third of systematic reviews changed or did not specify the primary outcome: a PROSPERO register study

J Clin Epidemiol. 2016 Nov:79:46-54. doi: 10.1016/j.jclinepi.2016.03.025. Epub 2016 Apr 11.

Authors

Affiliations

¹ Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael's Hospital, 209 Victoria Street, East Building, Toronto, Ontario M5B 1T8, Canada; Epidemiology Division, Dalla Lana School of Public Health, University of Toronto, 155 College Street, 6th Floor, Toronto, Ontario M5T 3M7, Canada. Electronic address: triccoa@smh.ca.
² Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael's Hospital, 209 Victoria Street, East Building, Toronto, Ontario M5B 1T8, Canada.
³ School of Public Health & Preventive Medicine, The Alfred Centre, Monash University, Level 6, 99 Commercial Road, Melbourne, Victoria 3004, Australia.
⁴ Canadian Agency for Drugs and Technologies in Health (CADTH), 865 Carling Avenue Suite 600, Ottawa, Ontario K1S 5S8, Canada; Department of Epidemiology and Community Medicine, University of Ottawa, 451 Smyth Road, Ottawa, Ontario K1H 8M5, Canada.
⁵ Centre for Reviews and Dissemination, University of York, Heslington, York YO10 5DD, United Kingdom.
⁶ Department of Biostatistics, Institute of Translational Medicine, University of Liverpool, Crown Street, Liverpool L69 3BX, United Kingdom.
⁷ Canadian Agency for Drugs and Technologies in Health (CADTH), 865 Carling Avenue Suite 600, Ottawa, Ontario K1S 5S8, Canada.
⁸ Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael's Hospital, 209 Victoria Street, East Building, Toronto, Ontario M5B 1T8, Canada; Department of Geriatric Medicine, University of Toronto, 27 King's College Circle, Toronto, Ontario M5S 1A1, Canada.
⁹ Ottawa Methods Centre, Ottawa Hospital Research Institute, The Ottawa Hospital, 501 Smyth Road, PO Box 201B, Ottawa, Ontario K1H 8L6, Canada.

PMID: 27079845
DOI: 10.1016/j.jclinepi.2016.03.025

Abstract

Objectives: To examine outcome reporting bias of systematic reviews registered in PROSPERO.

Study design and setting: Retrospective cohort study. The primary outcomes from systematic review publications were compared with those reported in the corresponding PROSPERO records; discrepancies in the primary outcomes were assessed as upgrades, additions, omissions, or downgrades. Relative risks (RRs) and 95% confidence intervals (CI) were calculated to determine the likelihood of having a change in primary outcome when the meta-analysis result was favorable and statistically significant.

Results: Ninety-six systematic reviews were published. A discrepancy in the primary outcome occurred in 32% of the included reviews and 39% of the reviews did not explicitly specify a primary outcome(s); 6% of the primary outcomes were omitted. There was no significant increased risk of adding/upgrading (RR, 2.14; 95% CI: 0.53, 8.63) or decreased risk of downgrading (RR, 0.76; 95% CI: 0.27, 2.17) an outcome when the meta-analysis result was favorable and statistically significant. As well, there was no significant increased risk of adding/upgrading (RR, 0.89; 95% CI: 0.31, 2.53) or decreased risk of downgrading (RR, 0.56; 95% CI: 0.29, 1.08) an outcome when the conclusion was positive.

Conclusions: We recommend review authors carefully consider primary outcome selection, and journals are encouraged to focus acceptance on registered systematic reviews.

Keywords: Bias; Methodology; Outcome reporting bias; Quality; Reporting; Systematic reviews.

MeSH terms

Bias
Cohort Studies
Epidemiologic Research Design*
Humans
Outcome Assessment, Health Care / methods*
Outcome Assessment, Health Care / statistics & numerical data*
Registries / statistics & numerical data*
Retrospective Studies
Review Literature as Topic*
Risk

Grants and funding

Canadian Institutes of Health Research /International