Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production

View ORCID ProfileBernhard A. Sabel, Emely Knaack, View ORCID ProfileGerd Gigerenzer, Mirela Bilc
doi: https://doi.org/10.1101/2023.05.06.23289563
Bernhard A. Sabel
1Institute of Medical Psychology, Medical Faculty, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany and Center for Brain and Behavioral Sciences (CBBS)
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Bernhard A. Sabel
  • For correspondence: bernhard.sabel@med.ovgu.de
Emely Knaack
1Institute of Medical Psychology, Medical Faculty, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany and Center for Brain and Behavioral Sciences (CBBS)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gerd Gigerenzer
2Max-Planck Institute for Human Development, Berlin, Germany
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Gerd Gigerenzer
Mirela Bilc
1Institute of Medical Psychology, Medical Faculty, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany and Center for Brain and Behavioral Sciences (CBBS)
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background Integrity of academic publishing is increasingly undermined by fake science publications massively produced by commercial “editing services” (so-called “paper mills”). They use AI-supported, automated production techniques at scale and sell fake publications to students, scientists, and physicians under pressure to advance their careers. Because the scale of fake publications in biomedicine is unknown, we developed a simple method to red-flag them and estimate their number.

Methods To identify indicators able to red-flagged fake publications (RFPs), we sent questionnaires to authors. Based on author responses, three indicators were identified: “author’s private email”, “international co-author” and “hospital affiliation”. These were used to analyze 15,120 PubMed®-listed publications regarding date, journal, impact factor, and country of author and validated in a sample of 400 known fakes and 400 matched presumed non-fakes using classification (tallying) rules to red-flag potential fakes. For a subsample of 80 papers we used an additional indicator related to the percentage of RFP citations.

Results The classification rules using two (three) indicators had sensitivities of 86% (90%) and false alarm rates of 44% (37%). From 2010 to 2020 the RFP rate increased from 16% to 28%. Given the 1.3 million biomedical Scimago-listed publications in 2020, we estimate the scope of >300,000 RFPs annually. Countries with the highest RFP proportion are Russia, Turkey, China, Egypt, and India (39%-48%), with China, in absolute terms, as the largest contributor of all RFPs (55%).

Conclusions Potential fake publications can be red-flagged using simple-to-use, validated classification rules to earmark them for subsequent scrutiny. RFP rates are increasing, suggesting higher actual fake rates than previously reported. The scale and proliferation of fake publications in biomedicine can damage trust in science, endanger public health, and impact economic spending and security. Easy-to-apply fake detection methods, as proposed here, or more complex automated methods can help prevent further damage to the permanent scientific record and enable the retraction of fake publications at scale.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

The study was funded by the Otto-v.-Guericke University of Magdeburg, Germany

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

All data produced in the present study are available upon reasonable request to the authors

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
Back to top
PreviousNext
Posted May 08, 2023.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production
Bernhard A. Sabel, Emely Knaack, Gerd Gigerenzer, Mirela Bilc
medRxiv 2023.05.06.23289563; doi: https://doi.org/10.1101/2023.05.06.23289563
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production
Bernhard A. Sabel, Emely Knaack, Gerd Gigerenzer, Mirela Bilc
medRxiv 2023.05.06.23289563; doi: https://doi.org/10.1101/2023.05.06.23289563

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Medical Ethics
Subject Areas
All Articles
  • Addiction Medicine (271)
  • Allergy and Immunology (553)
  • Anesthesia (135)
  • Cardiovascular Medicine (1761)
  • Dentistry and Oral Medicine (238)
  • Dermatology (173)
  • Emergency Medicine (312)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (660)
  • Epidemiology (10803)
  • Forensic Medicine (8)
  • Gastroenterology (592)
  • Genetic and Genomic Medicine (2952)
  • Geriatric Medicine (287)
  • Health Economics (534)
  • Health Informatics (1930)
  • Health Policy (836)
  • Health Systems and Quality Improvement (745)
  • Hematology (293)
  • HIV/AIDS (631)
  • Infectious Diseases (except HIV/AIDS) (12519)
  • Intensive Care and Critical Care Medicine (693)
  • Medical Education (299)
  • Medical Ethics (86)
  • Nephrology (324)
  • Neurology (2801)
  • Nursing (151)
  • Nutrition (433)
  • Obstetrics and Gynecology (559)
  • Occupational and Environmental Health (597)
  • Oncology (1469)
  • Ophthalmology (444)
  • Orthopedics (172)
  • Otolaryngology (257)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (381)
  • Pediatrics (867)
  • Pharmacology and Therapeutics (366)
  • Primary Care Research (337)
  • Psychiatry and Clinical Psychology (2641)
  • Public and Global Health (5374)
  • Radiology and Imaging (1013)
  • Rehabilitation Medicine and Physical Therapy (596)
  • Respiratory Medicine (726)
  • Rheumatology (330)
  • Sexual and Reproductive Health (289)
  • Sports Medicine (279)
  • Surgery (327)
  • Toxicology (47)
  • Transplantation (150)
  • Urology (125)