Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Investigating the transparency of reporting in two-sample summary data Mendelian randomization studies

View ORCID ProfileBenjamin Woolf, Nina Di Cara, Christopher Moreno-Stokoe, Veronika Skrivankova, Katie Drax, Julian P.T. Higgins, View ORCID ProfileGibran Hemani, Marcus R. Munafò, George Davey Smith, James Yarmolinsky, Rebecca C. Richmond
doi: https://doi.org/10.1101/2021.10.15.21264972
Benjamin Woolf
1School of Psychological Science, University of Bristol, Bristol, UK
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Benjamin Woolf
  • For correspondence: benjamin.woolf@bristol.ac.uk
Nina Di Cara
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
3Population Health Sciences, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher Moreno-Stokoe
1School of Psychological Science, University of Bristol, Bristol, UK
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Veronika Skrivankova
4Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Katie Drax
1School of Psychological Science, University of Bristol, Bristol, UK
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Julian P.T. Higgins
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
3Population Health Sciences, University of Bristol, Bristol, UK
5NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gibran Hemani
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
3Population Health Sciences, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Gibran Hemani
Marcus R. Munafò
1School of Psychological Science, University of Bristol, Bristol, UK
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
George Davey Smith
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
3Population Health Sciences, University of Bristol, Bristol, UK
5NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
James Yarmolinsky
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
3Population Health Sciences, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rebecca C. Richmond
2MRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK
3Population Health Sciences, University of Bristol, Bristol, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Two-sample Mendelian randomization (2SMR) is an increasingly popular epidemiological method that uses genetic variants as instruments for making causal inferences. Clear reporting of methods employed in such studies is important for evaluating their underlying quality. However, the quality of methodological reporting of 2SMR studies is currently unclear.

Objectives We aimed to assess the reporting quality of studies that used MR-Base, one of the most popular platforms for implementing 2SMR analysis.

Methods We created a bespoke reporting checklist to evaluate reporting quality of 2SMR studies. We then searched Web of Science Core Collection, PsycInfo, MEDLINE, EMBASE and Google Scholar citations of the MR-Base descriptor paper to identify published MR studies that used MR-Base for any component of the MR analysis. Study screening and data extraction were performed by at least two independent reviewers.

Results 87 studies were included in the primary analysis. Reporting quality was generally poor across studies with a mean of 53% (SD = 14%) of items reported in each study. Many items required for evaluating the validity of key assumptions made in MR were poorly reported: only 44% of studies provided sufficient details for assessing if the genetic variant associates with the exposure (‘relevance’ assumption), 31% for assessing if there are any variant-outcome confounders (‘independence’ assumption), 89% for the assessing if the variant causes the outcome independently of the exposure (‘exclusion restriction’ assumption), and 32% for assumptions of falsification tests. We did not find evidence of a change in reporting quality over time or a difference in reporting quality between studies that used MR-Base and a random sample of MR studies that did not use this platform.

Discussion The quality of reporting of two-sample Mendelian randomization studies in our sample was generally poor. Journals and researchers should implement the STROBE-MR guidelines to improve reporting quality.

Other: Funding ESRC, CRUK, MRC, John Climax Benevolent Fund, University of Bristol, and the Wellcome Trust. Registration: This study pre-registered on the OSF, and the protocol can be found at DOI 10.17605/OSF.IO/NFM27

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

Benjamin Woolf and CMS are funded by an Economic and Social Research Council (ESRC) South West Doctoral Training Partnership (SWDTP) 1+3 PhD Studentship Award (ES/P000630/1). James Yarmolinsky is supported by a Cancer Research UK Population Research Postdoctoral Fellowship (C68933/A28534). Katie Drax is funded by a John Climax Benevolent Fund. Rebecca Richmond is a de Pass VC Research Fellow at the University of Bristol. Nina DI Cara is funded by a GW4 BioMed Medical Research Council Doctoral Training Partnership Studentship. George Davey Smith works in the Medical Research Council Integrative Epidemiology Unit at the University of Bristol MC_UU_00011/1. Further support was provided by the UK Medical Research Council, which funds a Unit at the University of Bristol (MC_UU_00011/1, MC_UU_00011/7), and the CRUK-funded Integrative Cancer Epidemiology Programme (C18281/A1916). GH is funded by the Wellcome Trust [208806/Z/17/Z].

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All data produced in the present work are contained in the manuscript

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted October 18, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Investigating the transparency of reporting in two-sample summary data Mendelian randomization studies
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Investigating the transparency of reporting in two-sample summary data Mendelian randomization studies
Benjamin Woolf, Nina Di Cara, Christopher Moreno-Stokoe, Veronika Skrivankova, Katie Drax, Julian P.T. Higgins, Gibran Hemani, Marcus R. Munafò, George Davey Smith, James Yarmolinsky, Rebecca C. Richmond
medRxiv 2021.10.15.21264972; doi: https://doi.org/10.1101/2021.10.15.21264972
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Investigating the transparency of reporting in two-sample summary data Mendelian randomization studies
Benjamin Woolf, Nina Di Cara, Christopher Moreno-Stokoe, Veronika Skrivankova, Katie Drax, Julian P.T. Higgins, Gibran Hemani, Marcus R. Munafò, George Davey Smith, James Yarmolinsky, Rebecca C. Richmond
medRxiv 2021.10.15.21264972; doi: https://doi.org/10.1101/2021.10.15.21264972

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (228)
  • Allergy and Immunology (504)
  • Anesthesia (110)
  • Cardiovascular Medicine (1240)
  • Dentistry and Oral Medicine (206)
  • Dermatology (147)
  • Emergency Medicine (282)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (531)
  • Epidemiology (10023)
  • Forensic Medicine (5)
  • Gastroenterology (499)
  • Genetic and Genomic Medicine (2453)
  • Geriatric Medicine (238)
  • Health Economics (479)
  • Health Informatics (1643)
  • Health Policy (753)
  • Health Systems and Quality Improvement (636)
  • Hematology (248)
  • HIV/AIDS (533)
  • Infectious Diseases (except HIV/AIDS) (11864)
  • Intensive Care and Critical Care Medicine (626)
  • Medical Education (252)
  • Medical Ethics (75)
  • Nephrology (268)
  • Neurology (2281)
  • Nursing (139)
  • Nutrition (352)
  • Obstetrics and Gynecology (454)
  • Occupational and Environmental Health (537)
  • Oncology (1245)
  • Ophthalmology (377)
  • Orthopedics (134)
  • Otolaryngology (226)
  • Pain Medicine (158)
  • Palliative Medicine (50)
  • Pathology (324)
  • Pediatrics (730)
  • Pharmacology and Therapeutics (313)
  • Primary Care Research (282)
  • Psychiatry and Clinical Psychology (2281)
  • Public and Global Health (4834)
  • Radiology and Imaging (837)
  • Rehabilitation Medicine and Physical Therapy (492)
  • Respiratory Medicine (651)
  • Rheumatology (285)
  • Sexual and Reproductive Health (238)
  • Sports Medicine (227)
  • Surgery (267)
  • Toxicology (44)
  • Transplantation (125)
  • Urology (99)