PT  - JOURNAL ARTICLE
AU  - Wang, Yumin
AU  - Pitre, Tyler
AU  - Wallach, Joshua D.
AU  - de Souza, Russell J.
AU  - Jassal, Tanvir
AU  - Bier, Dennis
AU  - Patel, Chirag J.
AU  - Zeraatkar, Dena
TI  - Variations in the results of nutritional epidemiology studies due to analytic flexibility: Application of specification curve analysis to red meat and all-cause mortality
AID  - 10.1101/2023.12.19.23300248
DP  - 2023 Jan 01
TA  - medRxiv
PG  - 2023.12.19.23300248
4099  - http://medrxiv.org/content/early/2023/12/21/2023.12.19.23300248.short
4100  - http://medrxiv.org/content/early/2023/12/21/2023.12.19.23300248.full
AB  - Objective To present an application of specification curve analysis—a novel analytic method that involves defining and implementing all plausible and valid analytic approaches for addressing a research question—to nutritional epidemiology.Data source National Health and Nutrition Examination Survey (NHANES) 2007 to 2014 linked with National Death Index.Methods We reviewed all observational studies addressing the effect of red meat on all-cause mortality, sourced from a published systematic review, and documented variations in analytic methods (e.g., choice of model, covariates, etc.). We enumerated all defensible combinations of analytic choices to produce a comprehensive list of all the ways in which the data may reasonably be analyzed. We applied specification curve analysis to NHANES data to investigate the effect of unprocessed red meat on all-cause mortality, using all reasonable analytic specifications.Results Among 15 publications reporting on 24 cohorts included in the systematic review on red meat and all-cause mortality, we identified 70 unique analytic methods, each including different analytic models, covariates, and operationalizations of red meat (e.g., continuous vs. quantiles). We applied specification curve analysis to NHANES, including 10,661 participants. Our specification curve analysis included 1,208 unique analytic specifications. Of 1,208 specifications, 435 (36.0%) yielded a hazard ratio equal to or above 1 for the effect of red meat on all-cause mortality and 773 (64.0%) below 1, with a median hazard ratio of 0.94 [IQR: 0.83 to 1.05]. Forty-eight specifications (3.97%) were statistically significant, 40 of which indicated unprocessed red meat to reduce all-cause mortality and 8 of which indicated red meat to increase mortality.Conclusion We show that the application of specification curve analysis to nutritional epidemiology is feasible and presents an innovative solution to analytic flexibility.Limitations Alternative analytic specifications may address slightly different questions and investigators may disagree about justifiable analytic approaches. Further, specification curve analysis is time and resource-intensive and may not always be feasible.Competing Interest StatementDr Wallach reported receiving grant support from the FDA, Arnold Ventures, Johnson & Johnson through Yale University, and the National Institute on Alcohol Abuse and Alcoholism of the NIH under award 1K01AA028258; serving as a consultant for Hagens Berman Sobol Shapiro LLP and Dugan Law Firm APLC; and serving as a medRxiv affiliate.Funding StatementNo funding.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesUpon a reasonable request.