The effect of including the Nordic Hamstring exercise on sprint and jump performance in athletes: protocol of a systematic review and meta-analyses
===================================================================================================================================================

* Kasper Krommes
* Mathias F. Nielsen
* Laura Krohn
* Birk M. Grønfeldt
* Kristian Thorborg
* Per Hölmich
* Lasse Ishøi

## Abstract

The Nordic Hamstring exercise reduces hamstring strain injuries in football and other sports, but the exercise is not well adopted in practice. Barriers from practitioners include fear of performance decrements, due to lack of specificity of the exercise with high speed running. However, in theory, increased eccentric hamstring strength could transfer to faster sprinting due to higher horizontal force production. Studies on the effect of the Nordic Hamstring exercise on performance have been conflicting and no synthesis of the evidence exists. We therefore pose the following question: does including the Nordic Hamstring exercise hamper sprint or jump performance in athletes? We will answer this question by performing a systematic review of the literature, critically appraise relevant studies, and GRADE the evidence across key outcomes and perform meta-analyses, meta-regression and subgroup analyses. In this protocol we outline the planned methods and procedures.

**Progress report** Besides this protocol, our data extraction form and the process of data extraction has been piloted on 3 relevant studies, along with familiarization with the Risk of Bias 2.0 tool. We have also comprised a preliminary search strategy for PubMed.

**Supplementary files**

*   Data Extraction Form (.pdf)

*   Populated PRISMA-P checklist (.pdf)

Keywords
*   Nordic Hamstring Exercise
*   Eccentric Training
*   Hamstring Strain Injuries
*   Performance
*   Sprint
*   Jump
*   Agility
*   Change of Direction
*   Soreness
*   Systematic Review
*   Meta-analyses

## 1.0 BACKGROUND

### 1.1 Introduction

Exercise and sports participation benefits health,1–3 all-cause mortality4–6 and disease prevention.7–10 Football and its various codes are the most popular sports worldwide,11 but do carry risk of injuries,12 of which the most common and burdensome are hamstring strain injuries.13–15 These injuries are preventable by implementation of the Nordic Hamstring exercise in various doses,16 even in other sports besides football.17–19 However, even at the elite football level the exercise is not implemented,20 and hamstring strain injuries continue to top the injury-statistics.21 Narratives and surveys from the Sports Medicine community suggests that fear of performance-decrements and soreness from doing the exercise are barriers to implementation.22–25 Recently, randomized controlled trials from elite and amateur football and handball players have shown improvements in sprint performance after Nordic hamstring exercise-interventions,26–28 although the mechanism responsible has not yet been established.29 The most relevant performance measure in football and other sports is sprint ability,30,31 however, potential sprint performance effects of doing the Nordic Hamstring exercise has not yet been synthesized across studies. Such a synthesis address some of the concerns and barriers for implementation of the Nordic Hamstring exercise and supply new data-based arguments regarding impacts on performance, and in consequence likely increase adoption.

### 1.2 Objective and research questions

In order to provide a data-based estimate on the effect of including the Nordic Hamstring exercise in the team warm-up or in conditioning regiment on performance measures, we aim to answer the following questions:

#### Primary question

What is the effect of including the Nordic Hamstring exercise on sprint performance in athletes?

#### Secondary question

What is the effect of including the Nordic Hamstring exercise on other performance measures (such as: change of direction/agility, jumping, repeated sprint performance); and does it carry a risk of adverse events (soreness, injuries, and any other reported adverse events)?

## 2.0 METHODS

The protocol for this review will adhere to the PRISMA-P (Preferred Reporting Items for Systematic reviews and Meta-analyses - Protocol) statement32 and the proposed search-extension (PRISMA-S)33 to increase transparency and reproducibility,34 and we aim to fulfil items on AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews)35 to increase study quality, and ROBIS (Risk Of Bias In Systematic reviews)36 to minimize risk of bias. Additionally, the final report will adhere to the PRISMA statement and the extension for abstracts.37,38Along with this pre-printed protocol, we have registered the study in the PROSPERO (international PROSPEctive Register Of systematic reviews) repository before commencement of data collection to adhere to *a priori* decisions (submitted 31-MAR-2020, identifier pending).36,39 After a duration of public peer-review as pre-print, a possible updated version of the protocol will be uploaded before we commence data collection and perform literature searches, along with an update to the PROSPERO registration. After publication, all data (populated data extraction forms, search files, supplementary analyses, statistical code, bias- and GRADE (Grading of Recommendations Assessment, Development and Evaluation) assessments, populated PRISMA checklist) will be shared as supplementary files with no restrictions, either on our institutional website, per journal repository or other open access repository (e.g. figshare.com).

### 2.1 Outcomes

Modern football and other field-based sports is characterized by large amounts of sprint acceleration efforts,30 and consequently exercise interventions to improve this are considered a high priority.40,41 A decrease of 0.05 s in a 10 meter sprint time by an average player/athlete, may likely result in a 25–30 cm lead during a maximal 10 m sprint.42 In e.g. football, such a difference is considered clinically important, and may be crucial to reach a ball before the opponent player, block a shot, or score a goal.42 Most sprints in football are under 20 meters, 43 and while sprinting, team-sport athletes plateau in velocity after approximately 20 meters44 and thus acceleration will be classified as sprinting distances <20 meters and maximal velocity as sprinting distances ≥20 meters. To obtain low measurement error, we will only consider sprint times measured by sensor-based systems, such as high-speed video, laser-sensors, radar-gun, or force-plates.

#### Primary outcome

*   Change in sprint performance (seconds) during the phase of primarily acceleration (<20 meters)

#### Secondary outcomes (in prioritized order)

*   Change in sprint performance (seconds) during combined acceleration/maximal velocity phase (≥20 meters)

*   Changes in maximal velocity, measured as either velocity (m/s or km/h) or split times during maximal velocity running (between 20 to 40 meter)

*   Change in repeated sprint ability

*   Change in agility (such as: ‘change of direction’ test)

*   Changes in jump performance (such as countermovement-jump, drop-jump, squat-jump etc.)

*   Soreness or other adverse effects related to performing the Nordic Hamstring exercise

### 2.2 Criteria for eligibility of studies

#### 2.2.1 Outcomes of eligible studies

*   Change in sprint time during acceleration phase (split times on 0 – <20 meters)

*   Change in sprint time during acceleration and maximal velocity phase (split times on 0 - ≥20 meters)

*   Change in maximal velocity (velocity or split times on ≥20 – 40 meters)

*   Change in repeated sprint ability

*   Change in agility

*   Change in jump performance

*   Soreness or other adverse effects related to performing the Nordic Hamstring Exercise

#### 2.2.2 Interventions of eligible studies

Studies prescribing the Nordic Hamstring exercise in any dose exceeding a minimum of 1 set of 3 repetitions (minimum session-dose in the fifa11+ injury prevention programmes45) per week in volume for a minimum of 3 weeks will be considered. The Nordic hamstring exercise should be performed either as originally described by Mjølsnes *et al*46 or with arms positioned in front of- or behind the body, or on devices substituting the partner, such as the ‘Nordbord’, ‘Hamstring Solo’ or other equipment. Additional loading during the exercise to maintain the supramaximal loading of the exercise is allowed, but not assisted variations that decrease the load to below bodyweight. Such variations will however be allowed if the programme also includes the conventional Nordic Hamstring exercise. The Nordic hamstring exercise can be performed in isolation as the only intervention, or as add-on to other types of exercise or conditioning. The Nordic Hamstring exercise and original protocol utilized in the literature is described in figure 1.46

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/02/05/2020.04.01.20048686/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2021/02/05/2020.04.01.20048686/F1)

Figure 1. Description of the Nordic Hamstring Exercise and Protocol.

#### 2.2.3 Duration of follow-up in eligible studies

Studies doing follow-up testing 0 days to 4 weeks after termination of the intervention will be considered. For the acute effect of the Nordic Hamstring exercise, studies testing the same after doing the Nordic Hamstring Exercise will also be considered.

#### 2.2.4 Study design of eligible studies

All longitudinal studies implementing the Nordic Hamstring exercise will be considered, including single-group designs looking at within-group changes only, however, we will perform subgroup analyses for only RCTs and also for only low risk of bias RCTs.47 For the acute effect of the Nordic Hamstring exercise on sprint changes, cross-sectional studies with pre-post testing on the same day (effectively within-day longitudinal studies) will also be considered. Optimally, we would include only RCTs employing a non-inferiority framework, but given our knowledge of the field, such an evidence-pool is not available.

#### 2.2.5 Comparators of eligible studies

We will consider any comparators, such as usual training, no training, resistance training, specific sprint training or conditioning specifically for sprint performance enhancement. If studies have more than two groups we will use the Cochrane recommendations for deciding how to include data.48 For the primary analysis we will prioritize including usual care or similar comparators.

#### 2.2.6 Populations in eligible studies

Studies enrolling adult and adolescent participants (10-40 years) will be considered, whereas studies with children (<10 years) and older adults (>40 years) and the elderly will be excluded. Participants should at least be recreationally active, up to and including elite and professional athletes. We will perform subgroup analyses for adults or adolescents only (18-40 years, and 10-17 years), and for elite/professional athletes only.

### 2.3 Search strategy

We have consulted an expert football strength and conditioning coach at the elite level, and a research librarian for assistance in choosing terms and refining search strategy for the final search in PubMed, in addition to using the Word Frequency Analyser tool to suggest possible search terms from relevant literature (Systematic Review Accelerator, Institute for Evidence-Based Healthcare, Australia).49 We aim for a search strategy with high sensitivity and low precision. We have tested all terms individually, and some terms might be added or removed when applying the same strategy in other databases or platforms. Cochrane Central, Embase, PubMed and SPORTDiscus, will be sourced for relevant published studies,50 and the Polyglot Search Translator tool used to translated search strategies across databases (Systematic Review Accelerator, Institute for Evidence-Based Healthcare, Australia).51 In addition, any grey literature or unpublished data we can find through general search-engines (google.com, Google Scholar), forwards and backwards snowballing, trial-registries (ISRCTN, ICTRP, EU Register, OSF, ANZCTR), or by other means, will be sourced by hand search.52 The preliminary search matrix for PubMed is presented below (table 3), and will be adapted to all utilized databases to fit their respective search hierarchy, thesauruses, and operators. To our current knowledge of the field, titles and abstract does not always specify population or design fully thus we will not utilize search terms for these items, in order to not omit relevant studies. No filters or restrictions on dates, study design, population or language will be applied.53 If relevant articles with English abstracts but full-text language in other than Danish, Norwegian, Swedish or English languages are available, translation services will be sought. A copy of the search-results will be provided as supplementary files. The search process is planned for June 8th – June 16th 2020. For incomplete literature such as conference abstracts or theses, or insufficient reporting, we will contact corresponding authors to supply either the full report or information regarding risk of bias and GRADE assessment items, and to verify values for data extraction.

View this table:
[Table 1.](http://medrxiv.org/content/early/2021/02/05/2020.04.01.20048686/T1)

Table 1. 
Split sprint distances and their outcome-designation

View this table:
[Table 2.](http://medrxiv.org/content/early/2021/02/05/2020.04.01.20048686/T2)

Table 2. 
Short-form overview of key inclusion and exclusion criteria for eligible studies.

View this table:
[Table 3.](http://medrxiv.org/content/early/2021/02/05/2020.04.01.20048686/T3)

Table 3. 
Search matrix and terms for PubMed.

Two reviewers (KK & LI) will independently agree on selection of eligible studies to include using Endnote (Clarivate Analytics) to remove duplicates and screen records. If a consensus cannot be achieved a third reviewer (BG) will be involved. A improved PRISMA-style flowchart54 will be presented, and we will provide a list of studies excluded on abstract or full-text level as a supplementary. Entries from some registries will also be immediately screened in full to assess possible eligibility as importation to reference manager is not possible (OSF, ISRCTN, SportRxiv, MedRxiv). The level of inter-rater agreement at the abstract-level between reviewers before consensus will be reported as percentage of agreement and unweighted kappa values. Along with the publication of this protocol as pre-print, we are contacting field experts through social media and email for suggestion or additional possible relevant studies for inclusion. Citations will be managed in Endnote.

### 2.4 Data extraction

Duplicate data extraction will be performed by three independent reviewers, with two reviewers per study (MF, LK, BG),55 using a piloted data extraction form based on Cochrane templates56 and Center for Evidence-Based Medicine guidelines.57 we have provided the un-populated form as a supplementary (Data Extraction Form.pdf). Data only presented as visualization will be extracted using a web-based tool (WebPlotDigitizer 4.2, 2019, [https://automeris.io/WebPlotDigitizer](https://automeris.io/WebPlotDigitizer)). For extracting adverse events we will use a hybrid confirmatory-exploratory approach, in that we focus on soreness specifically and hereby pre-specified, and will also include any potential unrecognized or unspecified adverse events.58 For multiplicity of effect estimates, we will use an reductionist approach by including one estimate per analysis, per study-group, based on the follow criteria: 1) most recent (earliest follow-up measure) estimate, 2) intention-to-treat estimates, and 3) for sprint split times, the split closest to 20 meters.59 In cases of either missing data, or data extraction from visual reporting, we will contact corresponding authors by email and ask to either provide, or verify/correct data extraction values. For this, authors will be asked to supply data and study information through an electronic survey with the core data extraction items. After the initial email request, a reminder after 1 week, and contact by telephone (if telephone number is available and in service),60 none or the un-verified data extraction will be utilized. As a supplementary, we will list all studies included for which corresponding authors could not supply data or verify our visual extractions.

### 2.5 Critical appraisal

We will use Cochrane Risk of Bias Tool 2.041 to evaluate risk of bias in randomized trials.61 The ROBINS-I tool will be used for non-randomized trials.62 Risk of Bias evaluation will be done once per study based on outcomes as prioritized in the outcome-section. For sprint-outcomes where several eligible sprint-distances are available, only the ones closest to the 20 m cut-off will be used as to not double-count participant-data. No study will be excluded based on the results of the critical appraisal, but this information will be used for the quality of cumulative evidence assessment using the Cochrane Collaborations GRADE criteria63 and for subgroup analysis of ‘low risk of bias’ studies.30,64 Rating the quality of individual studies rather than assessing risk of bias is inappropriate and will not be performed.65,66 Reviewers will perform duplicate independent bias assessment with the assistance of a machine learning system67,68 (MF, LK, & BG), and duplicate GRADE evaluation (KK & LI) and will achieve consensus in case of conflicting assessments by involving an additional reviewer (KK & BG). The level of inter-tester agreement between appraisers before consensus will be reported as percentage of agreement and unweighted kappa values. In sports- and exercise trials, blinding participants and personnel delivering exercise-based interventions are not feasible and we will therefore not consider domains pertaining to these blinding situations when assigning studies to “low risk of bias” subgroup analysis. Details from included studies pertaining to reporting of funding, conflict of interests, transparency, intention-to-treat analyses and pre-registration will be reported alongside general study characteristics.

### 2.6 Analyses

Our meta-analyses of individual study results will be performed with a random effects model using the Restricted Maximum Likelihood (REML) method to estimate a pooled mean of the overall effect with 95% confidence intervals, and the between study variance of effect sizes (Tau-Squared, T2). We will report estimated effect size and interpreted it as a standardized mean difference (SMD) calculated as Cohens’ d. However, we will use a Hedges’ g correction to account for small sized studies. Heterogeneity in the meta-analyses will be tested with Cochranes’ Q-test (a chi2-test).66 The percentage of variability in the effect estimates which is due to heterogeneity between the studies rather than chance will be calculated and interpreted using the I2 statistic.66 Causes for heterogeneity will be explored through subgroup analyses and meta-regression analyses of clinical and/or methodological covariates. Categorical covariates (e.g. age categories, playing-level, comparator, duration or volume of the Nordic Hamstring exercise) will be investigated with stratified meta-analysis and continuous covariates (e.g. intervention dose) will be investigated with meta-regression. A covariate is considered relevant and to explain heterogeneity in the overall analyses if inclusion of the covariate reduces the overall Tau-Squared. If a substantial clinical heterogeneity or high risk of bias is found, combining data in meta-analysis might be inappropriate, hence analysis will only be presented without total effect estimates, as firm conclusions on these will be inappropriate. Instead, we will present a brief narrative analysis, and the possible causes for heterogeneity will be debated in the discussion-section. No other qualitative syntheses are planned. Differences in estimated effects between relevant categorical subgroups will be analysed using meta-regression. For evaluating the risk of publication- and small study bias, a contour-enhanced funnel plot69 will be provided in addition to the Eggers test for Funnel-asymmetry and small study bias70 and Beggs test for publication bias.71 If relevant, reasons for funnel-asymmetry will be debated in the discussion-section. Results of the two primary outcomes will be presented in forest plots to allow for visual comparisons between studies. To allow for a more clinically relevant interpretation of the meta-analyses estimates, we will convert the pooled estimate from SMD to log (Odds Ratio), so we can estimate the odds ratio for becoming faster or slower and calculate the number needed to treat for 1 athlete to e.g. get faster. Furthermore, we will also convert the pooled estimate from SMD to an original scale (e.g. seconds), to enhance clinical interpretation of the results. All analyses will be performed in Stata 16 IC (StataCorp LLC, USA). All planned analyses are provided in table 4. Results will be emphasized based on effect size and confidence intervals, rather than statistical significance.

View this table:
[Table 4.](http://medrxiv.org/content/early/2021/02/05/2020.04.01.20048686/T4)

Table 4. 
Overview of planned meta-analyses.

## Data Availability

After publication, all data (populated data extraction forms, search files, supplementary analyses, statistical code, bias- and GRADE (Grading of Recommendations Assessment, Development and Evaluation) assessments, populated PRISMA checklist) will be shared as supplementary files with no restrictions, either on our institutional website, per journal repository or other open access repository (e.g. figshare.com).

## Potential conflicts of interest

We have no financial interests to declare. Some of the authors (KK, KT, PH, LI) have previously published two trials within the scope of this review, in which the effect in both trials favours the experimental intervention and is thus subjected to confirmation bias and self-citation incentives.

## Funding and support

No specific funding were given for this study. No funding-or institutional body will have any control or involvement in data collection, analyses, interpretation, writing the report or decision to publish.

### Changelog from version 1.0 to 2.0 (04-JUNE-2021: before commencement of search)

*   Added DOI

*   Added soreness to search matrix

*   Added specific trials registries

*   Due to bugs and installation issues, SRA-helper and de-duplikator tools will not be utilized, and have been removed from the methods section

*   Due to pandemical issues, the planned dates for carrying out the search has been postponed to June 8-16, 2020

### Changelog from version 2.0 to 3.0 (05-FEB-2021: screening started, next step is full-text assessments)

*   Added PROSPERO registration ID.

*   Added a sensitivity analysis: “Only studies with other types of strength training as comparator”, as this was mistakenly left out in previous drafts.

*   Removed a sensitivity analysis from table 4: “Only studies with usual training or no intervention as comparator”, as this was in fact our primary analysis and was duplicated in table 4 mistakenly.

*   Post hoc change: Added further details on the data extraction of grey literature from authors, as we have started this process earlier than anticipated. We are currently doing it before full-text assessments, rather than after data-extraction as anticipated.

*   Post hoc change: Added details on screening of registry entries that was not possible to import into reference manager and was thus screen in full directly in the registry.

## Acknowledgement

The authors would like to thank Strength and Conditioning Coach Michael Myhre and Research Librarian Torben Jørgensen with help in choosing search terms and refining the search strategy.

## Author contributions

All authors contributed to the protocol. Contributions are visualized according to the CRediT framework (the Contributor Roles Taxonomy)72 in the following table.

View this table:
[Table5](http://medrxiv.org/content/early/2021/02/05/2020.04.01.20048686/T5)

## Footnotes

*   Changelog from version 2.0 to 3.0 (05-FEB-2021: screening started, next step is full-text assessments) - Added PROSPERO registration ID. - Added a sensitivity analysis: 'Only studies with other types of strength training as comparator', as this was mistakenly left out in previous drafts. - Removed a sensitivity analysis from table 4: 'Only studies with usual training or no intervention as comparator', as this was in fact our primary analysis and was duplicated in table 4 mistakenly. - Post hoc change: Added further details on the data extraction of grey literature from authors, as we have started this process earlier than anticipated. We are currently doing it before full-text assessments, rather than after data-extraction as anticipated. - Post hoc change: Added details on screening of registry entries that was not possible to import into reference manager and was thus screen in full directly in the registry. 

*   Received April 1, 2020.
*   Revision received February 5, 2021.
*   Accepted February 5, 2021.


*   © 2021, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NoDerivs 4.0 International), CC BY-ND 4.0, as described at [http://creativecommons.org/licenses/by-nd/4.0/](http://creativecommons.org/licenses/by-nd/4.0/)

## REFERENCES

1.  1.Garber, C. E. et al. American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. Med. Sci. Sports Exerc. 43, 1334–1359 (2011).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1249/MSS.0b013e318213fefb&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21694556&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000291924500026&link_type=ISI) 

2.  2.García-Hermoso, A., Ramírez-Campillo, R. & Izquierdo, M. Is Muscular Fitness Associated with Future Health Benefits in Children and Adolescents? A Systematic Review and Meta- Analysis of Longitudinal Studies. Sports Med. 49, 1079–1094 (2019).
    
    

3.  3.Oja, P. et al. Infographic: Health benefits of specific types of sports. Br. J. Sports Med. 51, 824–824 (2017).
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6OToiNTEvMTAvODI0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDIvMDUvMjAyMC4wNC4wMS4yMDA0ODY4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

4.  4.Mandsager, K. et al. Association of Cardiorespiratory Fitness With Long-term Mortality Among Adults Undergoing Exercise Treadmill Testing. JAMA Netw. Open 1, e183605–e183605 (2018).
    
    

5.  5.Saint-Maurice, P. F. et al. Association of Leisure-Time Physical Activity Across the Adult Life Course With All-Cause and Cause- Specific Mortality. JAMA Netw. Open 2, e190355–e190355 (2019).
    
    

6.  6.Clausen, J. S. R., Marott, J. L., Holtermann, A., Gyntelberg, F. & Jensen, M. T. Midlife Cardiorespiratory Fitness and the Long-Term Risk of Mortality: 46 Years of Follow-Up. J. Am. Coll. Cardiol. 72, 987–995 (2018).
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6MzoiUERGIjtzOjExOiJqb3VybmFsQ29kZSI7czo0OiJhY2NqIjtzOjU6InJlc2lkIjtzOjg6IjcyLzkvOTg3IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDIvMDUvMjAyMC4wNC4wMS4yMDA0ODY4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

7.  7.Shibata, S. et al. The effect of lifelong exercise frequency on arterial stiffness. J. Physiol. 596, 2783–2795 (2018).
    
    

8.  8.Friedenreich, C. M., Neilson, H. K., Farris, M. S. & Courneya, K. S. Physical Activity and Cancer Outcomes: A Precision Medicine Approach. Clin. Cancer Res. Off. J. Am. Assoc. Cancer Res. 22, 4766–4775 (2016).
    
    

9.  9.Larson, E. B. et al. Exercise is associated with reduced risk for incident dementia among persons 65 years of age and older. Ann. Intern. Med. 144, 73–81 (2006).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7326/0003-4819-144-2-200601170-00004&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16418406&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000234725500003&link_type=ISI) 

10. 10.Paley, C. A. & Johnson, M. I. Physical Activity to Reduce Systemic Inflammation Associated With Chronic Pain and Obesity: A Narrative Review. Clin. J. Pain 32, 365–370 (2016).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/AJP.0000000000000258&link_type=DOI) 

11. 11.FIFA.com. FIFA Big Count 2006: 270 million people active in football. FIFA.com [http://www.fifa.com/media/news/y=2007/m=5/news=fifa-big-count-2006-270-million-people-active-football-529882.html](http://www.fifa.com/media/news/y=2007/m=5/news=fifa-big-count-2006-270-million-people-active-football-529882.html) (2007).
    
    

12. 12.Ekstrand, J., Hägglund, M. & Waldén, M. Injury incidence and injury patterns in professional football: the UEFA injury study. Br. J. Sports Med. 45, 553–558 (2011).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6ODoiNDUvNy81NTMiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

13. 13.Ekstrand, J., Hägglund, M. & Waldén, M. Epidemiology of muscle injuries in professional football (soccer). Am. J. Sports Med. 39, 1226– 1232 (2011).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0363546510395879&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21335353&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000291204200020&link_type=ISI) 

14. 14.Brooks, J. H. M., Fuller, C. W., Kemp, S. P. T. & Reddin, D. B. Incidence, risk, and prevention of hamstring muscle injuries in professional rugby union. Am. J. Sports Med. 34, 1297–1306 (2006).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0363546505286022&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16493170&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000239168600011&link_type=ISI) 

15. 15.Petersen, J., Thorborg, K., Nielsen, M. B. & Hölmich, P. Acute hamstring injuries in Danish elite football: a 12-month prospective registration study among 374 players. Scand. J. Med. Sci. Sports 20, 588–592 (2010).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1600-0838.2009.00995.x&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19804575&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000279905400006&link_type=ISI) 

16. 16.Ishøi, L., Krommes, K., Husted, R. S., Juhl, C. B. & Thorborg, K. Diagnosis, prevention and treatment of common lower extremity muscle injuries in sport – grading the evidence: a statement paper commissioned by the Danish Society of Sports Physical Therapy (DSSF). Br. J. Sports Med. (2020) doi:10.1136/bjsports-2019-101228.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6ODoiNTQvOS81MjgiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

17. 17.Longo, U. G. et al. The FIFA 11+ program is effective in preventing injuries in elite male basketball players: a cluster randomized controlled trial. Am. J. Sports Med. 40, 996– 1005 (2012).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0363546512438761&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22415208&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

18. 18.Sugiura, Y., Sakuma, K., Sakuraba, K. & Sato, Y. Prevention of Hamstring Injuries in Collegiate Sprinters. Orthop. J. Sports Med. 5, (2017).
    
    

19. 19.Seagrave, R. A. et al. Preventive Effects of Eccentric Training on Acute Hamstring Muscle Injury in Professional Baseball. Orthop. J. Sports Med. 2, 2325967114535351 (2014).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/2325967114535351&link_type=DOI) 

20. 20.Bahr, R., Thorborg, K. & Ekstrand, J. Evidence-based hamstring injury prevention is not adopted by the majority of Champions League or Norwegian Premier League football teams: the Nordic Hamstring survey. Br. J. Sports Med. 49, 1466–1471 (2015).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6MTA6IjQ5LzIyLzE0NjYiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

21. 21.Ekstrand, J., Waldén, M. & Hägglund, M. Hamstring injuries have increased by 4% annually in men’s professional football, since 2001: a 13-year longitudinal analysis of the UEFA Elite Club injury study. Br. J. Sports Med. 50, 731–737 (2016).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6OToiNTAvMTIvNzMxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDIvMDUvMjAyMC4wNC4wMS4yMDA0ODY4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

22. 22.McCall, A. et al. Risk factors, testing and preventative strategies for non-contact injuries in professional football: current perceptions and practices of 44 teams from various premier leagues. Br. J. Sports Med. 48, 1352–1357 (2014).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6MTA6IjQ4LzE4LzEzNTIiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

23. 23.Guex, K. & Millet, G. P. Conceptual framework for strengthening exercises to prevent hamstring strains. Sports Med. Auckl. NZ 43, 1207–1215 (2013).
    
    

24. 24.Gambetta, V. More on Prevention as the Cause. Functional Path Training: [http://www.functionalpathtrainingblog.com/2011/05/more-on-prevention-as-the-cause-.html](http://www.functionalpathtrainingblog.com/2011/05/more-on-prevention-as-the-cause-.html) [http://www.functionalpathtrainingblog.com/2011/05/more-on-prevention-as-the-cause-.html](http://www.functionalpathtrainingblog.com/2011/05/more-on-prevention-as-the-cause-.html) (2016).
    
    

25. 25.Oakley, A. J., Jennings, J. & Bishop, C. J. Holistic hamstring health: not just the Nordic hamstring exercise. Br. J. Sports Med. 52, 816– 817 (2018).
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6OToiNTIvMTMvODE2IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDIvMDUvMjAyMC4wNC4wMS4yMDA0ODY4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

26. 26.Ishøi, L. et al. Effects of the Nordic Hamstring exercise on sprint capacity in male football players: a randomized controlled trial. J. Sports Sci. 1–10 (2017) doi:10.1080/02640414.2017.1409609.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/02640414.2017.1409609&link_type=DOI) 

27. 27.Krommes, K. et al. Sprint and jump performance in elite male soccer players following a 10-week Nordic Hamstring exercise Protocol: a randomised pilot study. BMC Res. Notes 10, 669 (2017).
    
    

28. 28.Chaabene, H. et al. Effects of an Eccentric Hamstrings Training on Components of Physical Performance in Young Female Handball Players. Int. J. Sports Physiol. Perform. 1–22 (2019) doi:10.1123/ijspp.2019-0005.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1123/ijspp.2019-0005&link_type=DOI) 

29. 29.Suarez-Arrones, L. et al. Dissociation between changes in sprinting performance and Nordic hamstring strength in professional male football players. PloS One 14, e0213375 (2019).
    
    

30. 30.Barnes, C., Archer, D. T., Hogg, B., Bush, M. & Bradley, P. S. The evolution of physical and technical performance parameters in the English Premier League. Int. J. Sports Med. 35, 1095– 1100 (2014).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1055/s-0034-1375695&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25009969&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

31. 31.Jeras, N. M. J., Bovend’Eerdt, T. J. H. & McCrum, C. Biomechanical mechanisms of jumping performance in youth elite female soccer players. J. Sports Sci. , 1–7 (2019).
    
    

32. 32.Shamseer, L. et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 350, g7647 (2015).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1136/bmj.g7647&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25555855&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

33. 33.Rethlefsen, M., Ayala, A. P., Kirtley, S., Koffel, J. & Waffenschmidt, S. PRISMA-S Draft. (2019) doi:10.17605/OSF.IO/7NCYS.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.17605/OSF.IO/7NCYS&link_type=DOI) 

34. 34.Lakens, D. et al. Examining the Reproducibility of Meta-Analyses in Psychology: A Preliminary Report. [https://osf.io/xfbjf](https://osf.io/xfbjf) (2017) doi:10.31222/osf.io/xfbjf.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.31222/osf.io/xfbjf&link_type=DOI) 

35. 35.Shea, B. J. et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 358, j4008 (2017).
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE4OiIzNTgvc2VwMjFfMTYvajQwMDgiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

36. 36.Whiting, P. et al. ROBIS: A new tool to assess risk of bias in systematic reviews was developed. J. Clin. Epidemiol. 69, 225–234 (2016).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2015.06.005&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26092286&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

37. 37.Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G. & PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J. Clin. Epidemiol. 62, 1006–1012 (2009).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2009.06.005&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19631508&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000270250500003&link_type=ISI) 

38. 38.Beller, E. M. et al. PRISMA for Abstracts: Reporting Systematic Reviews in Journal and Conference Abstracts. PLOS Med. 10, e1001419 (2013).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pmed.1001419&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23585737&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

39. 39.Palpacuer, C. et al. Vibration of effects from diverse inclusion/exclusion criteria and analytical choices: 9216 different ways to perform an indirect comparison meta-analysis. BMC Med. 17, 174 (2019).
    
    

40. 40.Haugen, T. Sprint conditioning of elite soccer players: Worth the effort or lets just buy faster players? 3 (2017).
    
    

41. 41.Haugen, T. The role and development of sprinting speed in soccer. (University of Agder, Faculty of Health and Sport Science, 2014).
    
    

42. 42.Haugen, T. & Buchheit, M. Sprint Running Performance Monitoring: Methodological and Practical Considerations. Sports Med. Auckl. NZ 46, 641–656 (2016).
    
    

43. 43.Andrzejewski, M., Chmura, J., Pluta, B., Strzelczyk, R. & Kasprzak, A. Analysis of Sprinting Activities of Professional Soccer Players: J. Strength Cond. Res. 27, 2134–2140 (2013).
    
    

44. 44.Clark, K. P., Rieger, R. H., Bruno, R. F. & Stearne, D. J. The National Football League Combine 40-yd Dash: How Important is Maximum Velocity? J. Strength Cond. Res. 33, 1542–1550 (2019).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1519/JSC.0000000000002081&link_type=DOI) 

45. 45.Thorborg, K. et al. Effect of specific exercise- based football injury prevention programmes on the overall injury rate in football: a systematic review and meta-analysis of the FIFA 11 and 11+ programmes. Br. J. Sports Med. 51, 562– 571 (2017).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYmpzcG9ydHMiO3M6NToicmVzaWQiO3M6ODoiNTEvNy81NjIiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

46. 46.Mjølsnes, R., Arnason, A., Østhagen, T., Raastad, T. & Bahr, R. A 10-week randomized trial comparing eccentric vs. concentric hamstring strength training in well-trained soccer players. Scand. J. Med. Sci. Sports 14, 311–317 (2004).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1046/j.1600-0838.2003.367.x&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15387805&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000224067200006&link_type=ISI) 

47. 47.Tan, A. C. et al. Prevalence of trial registration varies by study characteristics and risk of bias. J. Clin. Epidemiol. 113, 64–74 (2019).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2019.05.009&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31121304&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

48. 48.16.5.4 How to include multiple groups from one study. [https://handbook-5-1.cochrane.org/chapter\_16/16\_5\_4\_how\_to\_include\_multiple\_groups\_from\_one\_study.htm](https://handbook-5-1.cochrane.org/chapter\_16/16\_5\_4\_how\_to\_include\_multiple\_groups_from_one_study.htm).
    
    

49. 49.Clark, J. et al. A full systematic review was completed in 2 weeks using automation tools: a case study. J. Clin. Epidemiol. 121, 81–90 (2020).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2020.01.008&link_type=DOI) 

50. 50.Aagaard, T., Lund, H. & Juhl, C. Optimizing literature search in systematic reviews – are MEDLINE, EMBASE and CENTRAL enough for identifying effect studies within the area of musculoskeletal disorders? BMC Med. Res. Methodol. 16, (2016).
    
    

51. 51.Improving the translation of search strategies using the Polyglot Search Translator: a randomised controlled trial. Bond University Research Portal [https://research.bond.edu.au/en/datasets/improving-the-translation-of-search-strategies-using-the-polyglot](https://research.bond.edu.au/en/datasets/improving-the-translation-of-search-strategies-using-the-polyglot).
    
    

52. 52.Greenhalgh, T. & Peacock, R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ 331, 1064–1065 (2005).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEzOiIzMzEvNzUyNC8xMDY0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDIvMDUvMjAyMC4wNC4wMS4yMDA0ODY4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

53. 53.Beynon, R. et al. Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. Cochrane Database Syst. Rev. MR000022 (2013) doi:10.1002/14651858.MR000022.pub3.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/14651858.MR000022.pub3&link_type=DOI) 

54. 54.Vu-Ngoc, H. et al. Quality of flow diagram in systematic review and/or meta-analysis. PLOS ONE 13, e0195955 (2018).
    
    

55. 55.Jian-Yu, E. et al. Adjudication rather than experience of data abstraction matters more in reducing errors in abstracting data in systematic reviews. Res. Synth. Methods n/a,.
    
    

56. 56.Data extraction forms. /data-extraction-forms.
    
    

57. 57.Data Extraction in Meta-analysis. CEBM [https://www.cebm.net/2014/06/data-extraction-in-meta-analysis/](https://www.cebm.net/2014/06/data-extraction-in-meta-analysis/) (2014).
    
    

58. 58.Junqueira, D. 2019 Cochrane Methods Symposium Part 7: Special issues for addressing adverse effects. Cochrane Training [https://training.cochrane.org/resource/part-7-special-issues-addressing-adverse-effects](https://training.cochrane.org/resource/part-7-special-issues-addressing-adverse-effects).
    
    

59. 59.López-López, J. A., Page, M. J., Lipsey, M. W. & Higgins, J. P. T. Dealing with effect size multiplicity in systematic reviews and meta- analyses. Res. Synth. Methods 9, 336–351 (2018).
    
    

60. 60.Danko, K. J., Dahabreh, I. J., Ivers, N. M., Moher, D. & Grimshaw, J. M. Contacting authors by telephone increased response proportions compared with emailing: results of a randomized study. J. Clin. Epidemiol. 115, 150–159 (2019).
    
    

61. 61.Sterne, J. & et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ Press.
    
    

62. 62.Sterne, J. A. et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 355, i4919 (2016).
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE4OiIzNTUvb2N0MTJfMTEvaTQ5MTkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

63. 63.Santesso, N. et al. GRADE guidelines 26: informative statements to communicate the findings of systematic reviews of interventions. J. Clin. Epidemiol. (2019) doi:10.1016/j.jclinepi.2019.10.014.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2019.10.014&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31711912&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

64. 64.Schünemann, H. J., Fretheim, A. & Oxman, A. D. Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations. Health Res. Policy Syst. 4, 21 (2006).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1478-4505-4-21&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17147810&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

65. 65.Boutron, I. & Ravaud, P. Classification systems to improve assessment of risk of bias. J. Clin. Epidemiol. 65, 236–238 (2012).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2011.09.006&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22264767&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 

66. 66.Higgins, J. & Green, S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. Cochrane Collab. 2011,.
    
    

67. 67.Marshall, I. J., Kuiper, J. & Wallace, B. C. RobotReviewer: evaluation of a system for automatically assessing bias in clinical trials. J. Am. Med. Inform. Assoc. JAMIA 23, 193–201 (2016).
    
    

68. 68.Viswanathan, M. et al. Assessing the Risk of Bias in Systematic Reviews of Health Care Interventions. in Methods Guide for Effectiveness and Comparative Effectiveness Reviews (Agency for Healthcare Research and Quality (US), 2008).
    
    

69. 69.Sterne, J. A. C. et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 343, d4002 (2011).
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNDMvanVsMjJfMS9kNDAwMiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzAyLzA1LzIwMjAuMDQuMDEuMjAwNDg2ODYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

70. 70.Egger, M., Davey Smith, G., Schneider, M. & Minder, C. Bias in meta-analysis detected by a simple, graphical test. BMJ 315, 629–634 (1997).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMTUvNzEwOS82MjkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMi8wNS8yMDIwLjA0LjAxLjIwMDQ4Njg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

71. 71.Begg, C. B. & Mazumdar, M. Operating characteristics of a rank correlation test for publication bias. Biometrics 50, 1088–1101 (1994).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2307/2533446&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=7786990&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F02%2F05%2F2020.04.01.20048686.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1994QP05000016&link_type=ISI) 

72. 72.Holcombe, A. Farewell authors, hello contributors. Nature 571, 147–147 (2019).