Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

COVID-19 advocacy bias in the BMJ: meta-research evaluation

View ORCID ProfileKasper P. Kepp, View ORCID ProfileIoana Alina Cristea, View ORCID ProfileTaulant Muka, View ORCID ProfileJohn P.A. Ioannidis
doi: https://doi.org/10.1101/2024.06.12.24308823
Kasper P. Kepp
1Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA
2Epistudia, Bern, Switzerland.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kasper P. Kepp
Ioana Alina Cristea
1Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA
3Department of General Psychology, University of Padova, Padova, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ioana Alina Cristea
Taulant Muka
1Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA
2Epistudia, Bern, Switzerland.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Taulant Muka
John P.A. Ioannidis
1Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA
4Departments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, Stanford University, Stanford, CA 94305, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for John P.A. Ioannidis
  • For correspondence: jioannid@stanford.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Objectives During the COVID-19 pandemic, BMJ, the premier journal on evidence-based medicine worldwide, published many views by advocates of specific COVID-19 policies. We aimed to evaluate the presence and potential bias of this advocacy.

Design and Methods Scopus was searched for items published until April 13, 2024 on “COVID-19 OR SARS-CoV-2”. BMJ publication numbers and types before (2016−2019) and during (2020−2023) the pandemic were compared for a group of advocates favoring aggressive measures (leaders of both the Independent Scientific Advisory Group for Emergencies (indieSAGE) and the Vaccines-Plus initiative) and four control groups: leading members of the governmental Scientific Advisory Group for Emergencies (SAGE), UK-based key signatories of the Great Barrington Declaration (GBD) (favoring more restricted measures), highly-cited UK scientists, and UK scientists who published the highest number of COVID-19-related papers in the entire scientific literature (n=16 in each group).

Results 122 authors published more than 5 COVID-19-related items each in BMJ. Of those, 18 were leading members/signatories of aggressive measures advocacy groups publishing 231 COVID-19 related BMJ documents, 53 were editors/journalists, and 51 scientists were not identified as associated with any advocacy. Of 41 authors with >10 publications in BMJ, 8 were scientists advocating for aggressive measures, 7 were editors, 23 were journalists, and only 3 were non-advocate scientists. Some aggressive measures advocates already had strong BMJ presence pre-pandemic. During pandemic years, the studied indieSAGE/Vaccines-Plus advocates outperformed in BMJ presence leading SAGE members by 16.0-fold, UK-based GBD advocates by 64.2-fold, the most-cited scientists by 16.0-fold, and the authors who published most COVID-19 papers overall by 10.7-fold. The difference was driven mainly by short opinion pieces and analyses.

Conclusions BMJ appears to have favored and massively promoted specific COVID-19 advocacy views during the pandemic, thereby strongly biasing the scientific picture on COVID-19.

Section 1: What is already known on this topic

  • Advocacy is intensely debated for its merits to science and policy.

  • Many journals increasingly publish pieces by advocates and it is thus important to understand the nature, scale and impact of this phenomenon.

Section 2: What this study adds

  • This study provides a detailed quantitative assessment of journal-promoted advocacy, focusing on the world’s premier evidence-based medical journal, the BMJ.

  • We show that BMJ had massive bias towards specific COVID-19-related advocacy favoring aggressive measures.

  • Our study reveals a need for editorial guidelines on journal-promoted advocacy.

Competing Interest Statement

According to Scopus, JPAI has published 75 items over the last 30 years in the BMJ (categorized by Scopus as Articles (n=43), Reviews (n=12), Letters (n=10), Editorials (n=7) and Short Surveys (n=3) and is thus ranked 160th among the most-prolific authors in BMJ. Of the 75 items, 3 are related to COVID-19: a non-commissioned opinion piece where he has declared his opposition to signing petitions, memoranda, declarations, and any other open advocacy letters as a means to settle scientific matters; a debate article on lockdowns; and an editorial on the peer review congress co-sponsored by BMJ and his center (METRICS). IAC has published 2 Articles in BMJ and TM has published one Review in BMJ, all unrelated to COVID-19. All authors have had COVID-19-related submitted papers to BMJ rejected in ways that violated COPE ethical principles (e.g. unethical comments by advocate reviewers, decision reached but not communicated to the authors, decision signed by person not previously listed in the BMJ website as an editor, decision delayed inappropriately for time-sensitive papers). According to Scopus (all publications considered), JPAI has published 102 COVID-19-related items, TM has published 10, IAC has published 8, and KPK has published 10 COVID-19-related items.

Funding Statement

This study did not receive any funding.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

All data used in this study are publicly available at BMJ or can be obtained via SCOPUS. We provide relevant raw data in Supplementary information. If any data or calculations remain unclear, readers are warmly welcome to contact the authors.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC 4.0 International license.
Back to top
PreviousNext
Posted June 14, 2024.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
COVID-19 advocacy bias in the BMJ: meta-research evaluation
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
COVID-19 advocacy bias in the BMJ: meta-research evaluation
Kasper P. Kepp, Ioana Alina Cristea, Taulant Muka, John P.A. Ioannidis
medRxiv 2024.06.12.24308823; doi: https://doi.org/10.1101/2024.06.12.24308823
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
COVID-19 advocacy bias in the BMJ: meta-research evaluation
Kasper P. Kepp, Ioana Alina Cristea, Taulant Muka, John P.A. Ioannidis
medRxiv 2024.06.12.24308823; doi: https://doi.org/10.1101/2024.06.12.24308823

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (405)
  • Allergy and Immunology (714)
  • Anesthesia (209)
  • Cardiovascular Medicine (2986)
  • Dentistry and Oral Medicine (337)
  • Dermatology (254)
  • Emergency Medicine (446)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1056)
  • Epidemiology (12848)
  • Forensic Medicine (12)
  • Gastroenterology (839)
  • Genetic and Genomic Medicine (4652)
  • Geriatric Medicine (428)
  • Health Economics (735)
  • Health Informatics (2960)
  • Health Policy (1076)
  • Health Systems and Quality Improvement (1097)
  • Hematology (394)
  • HIV/AIDS (938)
  • Infectious Diseases (except HIV/AIDS) (14176)
  • Intensive Care and Critical Care Medicine (859)
  • Medical Education (430)
  • Medical Ethics (116)
  • Nephrology (478)
  • Neurology (4441)
  • Nursing (239)
  • Nutrition (653)
  • Obstetrics and Gynecology (820)
  • Occupational and Environmental Health (741)
  • Oncology (2310)
  • Ophthalmology (655)
  • Orthopedics (260)
  • Otolaryngology (328)
  • Pain Medicine (286)
  • Palliative Medicine (85)
  • Pathology (504)
  • Pediatrics (1205)
  • Pharmacology and Therapeutics (511)
  • Primary Care Research (506)
  • Psychiatry and Clinical Psychology (3825)
  • Public and Global Health (7039)
  • Radiology and Imaging (1557)
  • Rehabilitation Medicine and Physical Therapy (931)
  • Respiratory Medicine (927)
  • Rheumatology (447)
  • Sexual and Reproductive Health (450)
  • Sports Medicine (387)
  • Surgery (494)
  • Toxicology (60)
  • Transplantation (213)
  • Urology (186)