ABSTRACT
Background The Cochrane Collaboration has been publishing systematic reviews in the Cochrane Database of Systematic Reviews (CDSR) since 1995, with the intention that these be updated periodically.
Objectives To chart the long-term updating history of a cohort of Cochrane reviews and the impact on the number of included studies.
Methods The status of a cohort of Cochrane reviews updated in 2003 was assessed at three time points: 2003, 2011, and 2018. We assessed their subject scope, compiled their publication history using PubMed and CDSR, and compared them to all Cochrane reviews available in 2002 and 2017/18.
Results Of the 1,532 Cochrane reviews available in 2002, 11.3% were updated in 2003, with 16.6% not updated between 2003 and 2011. The reviews updated in 2003 were not markedly different to other reviews available in 2002, but more were retracted or declared stable by 2011 (13.3% versus 6.3%). The 2003 update led to a major change of the conclusions of 2.8% of updated reviews (n = 177). The cohort had a median time since publication of the first full version of the review of 18 years and a median of three updates by 2018 (range 1–11). The median time to update was three years (range 0–14 years). By the end of 2018, the median time since the last update was seven years (range 0–15). The median number of included studies rose from eight in the version of the review before the 2003 update, to 10 in that update and 14 in 2018 (range 0–347).
Conclusions Most Cochrane reviews get updated, however they are becoming more out-of-date over time. Updates have resulted in an overall rise in the number of included studies, although they only rarely lead to major changes in conclusion.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
No external funding for this project. Hilda Bastian received support from an Australian Government Research Training Program Scholarship.
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Data availability Data and supporting files, including analytic code, available at: https://github.com/hildabast/cochrane-updating/
Ethics No patient involvement; ethical approval not required.
Data Availability
Data and supporting files, including analytic code, are available at GitHub
Abbreviations
- CDSR
- Cochrane Database of Systematic Reviews (journal component of The Cochrane Library)
- CI
- Confidence interval
- CRG
- Cochrane review group
- IQR
- Interquartile range
- PRISMA
- Preferred Reporting Items for Systematic Reviews and Meta-Analyses
