Hidden changes to prespecified primary outcomes of clinical trials completed between 2009 and 2017 in German University Medical Centres: A meta-research study
==============================================================================================================================================================

* Martin R. Holst
* Martin Haslberger
* Samruddhi Yerunkar
* Daniel Strech
* Lars G. Hemkens
* Benjamin G. Carlisle

## Abstract

**Objectives** To assess how often clinical trials exhibit primary outcome discrepancies within registry records that would not be caught by comparing results publications to the latest registry entry, but would require analysing the registration history.

**Design** Meta-research study.

**Setting** All 1746 randomised clinical trials with published results, registered in [ClinicalTrials.gov](http://ClinicalTrials.gov) or Deutsches Register Klinischer Studien (DRKS), completed at German University Medical Centres between 2009 and 2017. We analysed registry entries for all trials and publications for a random sample of 292 trials.

**Participants** Not applicable.

**Interventions** Not applicable.

**Main outcome measures** [1] Primary outcome discrepancies between registry entries at key study milestones and [2] the first results publication. [3] ‘Hidden’ discrepancies, i.e., only reported in the registry before the last entry, meaning they would only be detected by assessing the full registry change history. We considered discrepancies major if primary outcomes were newly added, dropped, or changed to or from secondary outcomes. [4] Proportion of publications transparently reporting discrepancies. [5] Characteristics associated with ‘open’ and ‘hidden’ discrepancies.

**Results** Of all 1746 trials, 23% (n=393) had primary outcome discrepancies between trial start and latest registry entry, with 8% (n=142) being major. Primary outcomes in publications were different from the latest registry entry in 41% of trials (120 of the 292 sampled trials; 95% CI [35%, 47%]), with major discrepancies in 18% (54 of 292; 95% CI [14%, 23%]). ‘Hidden’ discrepancies were observed in 14% of trials (41/292; 95% CI [10%, 19%]). Only 1% of discrepancies were reported in the publications (2/161, 95% CI [0%, 4%]). Trials were more likely to have a within-registry discrepancy if they had an earlier registration year (OR 0.74; 95% CI [0.69, 0.80]), were registered on [ClinicalTrials.gov](http://ClinicalTrials.gov) (OR 0.41; 95% CI [0.23, 0.70]), or had been industry-sponsored (OR 0.29; 95% CI [0.21, 0.41]).

**Conclusions** Changes to primary trial outcomes are common, often have major relevance, are rarely transparently reported and typically not detectable with an inspection of the latest registry entry. Authors need to be more transparent and registry entries of published trials need to require more in-depth analysis to reveal potentially misleading reporting practices.

**Protocol registration** Open Science Framework ([https://osf.io/t3qva](https://osf.io/t3qva); amendment in [https://osf.io/qtd2b](https://osf.io/qtd2b)).

Keywords
*   Clinical Trials
*   Registration
*   Reporting
*   Transparency

## Introduction

Clinical trial registries are critical tools to enhance the transparency and trustworthiness of clinical trial evidence by openly reporting key study parameters in a rapidly accessible manner (1). They make it possible to detect selective reporting biases that pose a major threat to trustworthiness. One of the most critical possible deviations from an original protocol and analysis plan is a change to prespecified outcomes. Consequently, outcomes and their pre-specification are among the most critical reporting items of clinical trials, with the CONSORT statement asking to describe ‘completely defined pre-specified primary and secondary outcome measures, including how and when they were assessed’ as well as ‘any changes to trial outcomes after the trial commenced, with reasons’ (2). If readers do not know if the outcomes were changed, they cannot assess the risk of bias due to ‘cherry picking’ of results or implications of multiple testing (3).

Many clinical trial registries, such as [ClinicalTrials.gov](http://ClinicalTrials.gov), allow entries to be updated after initial registration. While updating a registry entry is generally useful, as it is not unusual for parts of a trial protocol to change and desirable for an entry to reflect the most current information, it constitutes another possible source of reporting bias if entries are not properly maintained and larger changes go unreported. While a number of ethical and reporting guidance documents recommend prospective trial registration (2,4,5) and some recommend the transparent reporting of protocol changes (2,4), this is only checked in a minority of cases by peer-reviewers (6). But even if considered, looking only at the latest registry entry may lead to a wrong assessment, as changes to the entry over the course of the study would remain ‘hidden behind the latest entry’. One would have to take a closer look at the history of changes, which some trial registries maintain, but which is often not easily accessible.

Several analyses have already assessed the frequency of outcome discrepancies between registries and publications. They widely agree that this problem is very common, with a median estimated prevalence of 31% of clinical trials affected by primary outcome changes (interquartile range across analyses: 17-45 %) (7). However, most studies published to date did not report which registry entry version they used (8–16), assessed discrepancies between the publication and the latest available registry entry (17–19), or the latest registry entry before trial completion (20); some also used the first available entry or first entry during the active phase (21,22). Some studies determined the timepoint of primary outcome registration and the timepoints of changes using registry histories (23–28). Only two studies assessed changes over the course of the registry history, using small samples and a simple terminology (29,30). No study quantified the number of changes missed by considering only the latest registry entries.

In this study, we aimed to assess [1] how often changes to primary outcomes of clinical trials are reported in clinical trial registries across all available registry entry versions (‘within-registry discrepancies’), [2] how often there are discrepancies between the latest registry entry and the results publication (‘registry-publication discrepancies’), [3] how many changes are ‘hidden’ behind the latest registry entry, i.e., are ‘within-registry’, but do not show up as ‘registry-publication discrepancies’ and are therefore easily missed in review, [4] how often both types of outcome changes are transparently reported in the results publications, and [5] which trial characteristics are associated with these reporting deficits.

## Methods

### Data sources and sample

We based our analyses on two published datasets (from the IntoValue projects, 31,32) containing all interventional studies completed at German University Medical Centres between 2009 and 2017. The trials had been registered in either [ClinicalTrials.gov](http://ClinicalTrials.gov) or the Deutsches Register Klinischer Studien (DRKS), which is the WHO primary trial registry for Germany. Both registries have an accessible history of changes. Our datasets also include links to corresponding results publications, which had been manually identified. We retrieved a combined dataset for both projects from a GitHub repository ([https://github.com/maia-sh/intovalue-data](https://github.com/maia-sh/intovalue-data)), accessed on 24 January 2022).

### Eligibility criteria

We included any study that: 1) has a registry entry in either the [ClinicalTrials.gov](http://ClinicalTrials.gov) or the DRKS database, 2) was completed between 2009 and 2017 according to the trial status described as ‘Completed’, ‘Unknown status’, ‘Terminated’, or ‘Suspended’ ([ClinicalTrials.gov](http://ClinicalTrials.gov)), or ‘Recruiting complete, follow-up complete’, ‘Recruiting stopped after recruiting started’, or ‘Recruiting suspended on temporary hold’ (DRKS), 3) reported in the registry that a German University Medical Centre was involved (i.e., mentioned as responsible party, lead/primary sponsor, principal investigator, study chair, study director, facility, collaborator, or recruitment location; for definitions see 31,32), 4) has published results, i.e., a full-text publication of the trial results was found by the search methods described in the IntoValue protocols (31,32), 5) is registered as a randomised trial.

### Data extraction and processing

We used a stepwise approach of automatic data extraction and processing followed by reviewer assessment of identified outcome discrepancies, first comparing outcomes within the registry and second comparing registry entries with publications.

#### Automatic data extraction and processing

We obtained trial identifiers (NCT or DRKS number) and basic information about the trials and accompanying publications from the IntoValue dataset (31,32). We then downloaded all historical registry entries of these trials, using the cthist R package (33), on 24 January 2022 (DRKS) and 12 April 2022 ([ClinicalTrials.gov](http://ClinicalTrials.gov)). We extracted data from the fields listed in the codebook ([https://osf.io/syux2](https://osf.io/syux2)). For our classification of within-registry discrepancies, we extracted primary and secondary outcomes at four key registration milestones: [1] the first entry after study start (inclusion of the first patient), [2] the latest entry before the end of active status (determined e.g. by ‘completed’ status in the registry), [3] the latest entry before publication of the results in a journal, and [4] latest available entry.

We classified trials into medical fields based on their journal’s category from the SCImago Journal & Country Rank database (34), which is based on the Scopus medical field classification. The journals’ categories were divided into 17 higher-order categories based on consensus (MRH, MH, LGH).

#### Assessment of within-registry outcome discrepancies

Two reviewers (MRH, MH) conducted the assessment of within-registry discrepancies in duplicate and resolved conflicts through discussion. Reviewers assessed changes to the primary outcomes between the four key trial milestones within the registry (Figure 1), using a classification system based on prior assessments of outcome switching (23,35) and descriptions of the specification of primary outcome measures (36) (Table 1).

View this table:
[Table 1.](http://medrxiv.org/content/early/2023/02/21/2023.02.20.23286182/T1)

Table 1. 
Categorisation of outcome discrepancies. Multiple categories could be present between two timepoints.

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/02/21/2023.02.20.23286182/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2023/02/21/2023.02.20.23286182/F1)

Figure 1. 
Key trial timepoints analysed for outcome discrepancies in this study. Any changes of primary outcomes between study start and last available entry (i.e., within-registry discrepancies; registry data were downloaded in January 2022 for DRKS and in April 2022 for [ClinicalTrials.gov](http://ClinicalTrials.gov)) were considered and compared to the journal publication (i.e., registry-publication discrepancies).

#### Assessment of registry-publication outcome discrepancies

For feasibility, we drew a random sample of 300 publications, from which three reviewers (MRH, MH, SY) extracted primary outcomes. Some of these publications, however, turned out to not be the primary results publications of their respective trials. If the reviewers could not find the correct publication, they excluded the publication, reducing the final sample size to 292. We considered outcomes primary if they were explicitly named as such using a list of keywords (‘primary’ / ‘main’ / ‘outcome’ / ‘endpoint’ / ‘end point’). Otherwise, we used the outcome used for sample size calculation. In all other cases, we used the first reported outcome in the abstract and results section (with priority given to the abstract). For each entry, reviewers compared the extracted primary outcome(s) with the latest available registry entry using the developed rating system (Table 1). Reviewers also recorded whether there were any mentions of outcome changes in the assessed publications. Conflicts were resolved through discussion between raters.

#### Inter-rater agreement

The overall inter-rater agreement over all timepoints and items (measured by Cohen’s kappa) during screening was κ = 0.81 for the within-registry ratings and κ = 0.46 during the registry-publication ratings. Disagreement resulted partly from cases without clear reporting of primary outcomes in publications (if only explicitly mentioned outcomes were used for the registry-publication ratings, inter-rater agreement was κ = 0.51). In a post-hoc sensitivity analysis we restricted our analysis to primary outcomes explicitly named as such in the publications or used for sample size calculation.

### Statistical analyses and reporting

We report descriptive statistics for the rates of different types of outcome discrepancies within the registry entries (between key trial milestones), and between the latest registry entries and results publications. For proportions within the random sample of 292 trials with manual assessment of publications, we report 95% confidence intervals. For the analysis of determinants of within-registry outcome discrepancies or registry-publication outcome discrepancies, we used logistic regressions, with either any within-registry outcome discrepancy, or any registry-publication outcome discrepancy, as response variables, and a set of 9 candidate predictors (study phase, sponsor, publication year, registration year, medical field, registry, multicenter trial, enrollment, intervention). These variables were prespecified before the start of regression analyses (details in Supplementary Table 1).

#### Software

We used the R package cthist (33) to download clinical trial registration histories, Numbat Systematic Review Manager (37) for data extraction, and R (38) for data processing and statistical analyses.

#### Reporting

We used the STROBE guideline (39) to structure our manuscript.

## Results

We included 1746 clinical trials completed at German University Medical Centres between 2009 and 2017 (Table 2; Figure 2). Median registered sample size of these trials was 100, their median registration year 2011 and median publication year 2015. The largest fields represented by these trials were general medicine (29%) and internal medicine (17%). Industry was the lead sponsor for 26% of trials.

View this table:
[Table 2.](http://medrxiv.org/content/early/2023/02/21/2023.02.20.23286182/T2)

Table 2. 
Characteristics of included trials.

![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/02/21/2023.02.20.23286182/F2.medium.gif)

[Figure 2.](http://medrxiv.org/content/early/2023/02/21/2023.02.20.23286182/F2)

Figure 2. 
Study flowchart.

### Prevalence of outcome discrepancies

#### Primary outcome discrepancies within trial registries

Of 1746 trials, 393 (23%) had an outcome discrepancy reported within the registry (Table 3; Figure 3), 142 trials (8%) had major discrepancies, i.e., a primary outcome was newly added, dropped, or changed to or from a secondary outcome. Of these major discrepancies, 66 (4%) happened during the active phase of the trial, i.e., after first patient inclusion and before the trial status was set to ‘completed’, another 49 (3%) between completion and publication, and 36 (2%) after publication. Minor discrepancies were seen in 318 (18%) trials.

View this table:
[Table 3.](http://medrxiv.org/content/early/2023/02/21/2023.02.20.23286182/T3)

Table 3. 
Primary outcome discrepancies in 1746 trials published between 2009 to 2017. The table shows the changes of primary outcomes reported in the registries at different trial timepoints compared to previous registry entries and the discrepancies detected in results publications compared to the latest registry entry.

![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/02/21/2023.02.20.23286182/F3.medium.gif)

[Figure 3.](http://medrxiv.org/content/early/2023/02/21/2023.02.20.23286182/F3)

Figure 3. 
Percentage of trials showing primary outcome discrepancies within the registry history per trial phase. ‘No information’ means that a trial did not have a registry entry at that time or did not have any updates to the registry entry at that time.

#### Primary outcome discrepancies between registry entries and publications

Out of 292 randomly selected trials among the 1746 trials, 120 (41%; 95% CI [35%, 47%]) had a discrepancy between the latest registry entry and the publication, of which 54 (18%; 95% CI [14%, 23%]) were major and 75 (26%; 95% CI [21%, 31%]) were minor discrepancies.

### Hidden changes of primary outcomes

Among the 292 trials, 161 (55%: 95% CI [49%, 61%]) had an outcome discrepancy at any stage (Figure 4; Figure S1 and S2). There were discrepancies only between the latest registry entry and the publication in 95 trials (33%; 95% CI [27%, 38%]), with 42 being major (14%) and 61 being minor (21%); discrepancies only within the registry histories in 41 trials (14%; 95% CI [10%, 19%]) with 13 being major (4%) and 35 being minor (12%); and 25 trials (9%; 95% CI [6%, 12%]), 12 major (4%) and 14 minor (5%), had discrepancies both between the latest registry entry and the publication and also within the registry.

![Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/02/21/2023.02.20.23286182/F4.medium.gif)

[Figure 4.](http://medrxiv.org/content/early/2023/02/21/2023.02.20.23286182/F4)

Figure 4. 
UpSet plot showing the prevalence of any change at the different time point combinations in a random sample of 292 trials. The first bar from the left shows the number of trials that only show a discrepancy between the latest entry and the publication (95 trials, 32.5%). The number of trials showing outcome discrepancies within the registry at different timepoints after trial start (all other bars), adds up to 66 trials (22.6%). 41 trials (14.0%) exhibit changes in the registry, but the latest entry and outcome description in the publication correspond, i.e., outcome discrepancies would not be detected by comparing the publication to the latest available registry entry. 131 trials did not have any change in the registry or between registry and publication (44.9%).

### Reporting of changes in the publications

Only two of the 161 trials with any change to the outcomes reported this change in the publication (1%, 95% CI [0%, 4%]). One of the trials, which exhibited a major change both within the registry (between completion and publication) and between the latest registry entry and publication, stated that some of the primary outcomes were going to be reported in a separate manuscript (40). The other publication, which had a major change between the latest entry and the publication, stated that the changed outcome was the ‘more sensitive and direct measurement’ (41).

### Trial characteristics associated with outcome changes (within-registry and registry-publication)

Within-registry outcome changes were more likely in industry-sponsored trials (47% Industry vs 14% Non-Industry, OR 0.29, 95% CI [0.21, 0.41], p < 0.001; Supplementary Table 1), trials registered on [ClinicalTrials.gov](http://ClinicalTrials.gov) (27% [ClinicalTrials.gov](http://ClinicalTrials.gov) vs 5% DRKS, OR 0.41, 95%CI [0.23, 0.70], p = 0.002), and trials that were registered earlier (per registration year; OR 0.74, 95% CI [0.69, 0.80], p < 0.001). No statistically significant association with any other trial characteristic was found.

For registry-publication outcome discrepancies, we identified no statistically significant association with any candidate predictor (Supplementary Table 2).

We detected no statistically significant association between within-registry outcome discrepancies and registry-publication outcome discrepancies (Supplementary Table 3).

Results were similar in the sensitivity analysis (Supplementary Table 4).

## Discussion

Our assessment of all 1746 published clinical trials conducted at German university medical centres that were completed between 2009 and 2017 shows that changes to primary outcomes are very common. About one in four trials (23%) has discrepancies within the registry after study start; a major discrepancy occurs within one in twelve trials (8%). Of the 292 assessed publications, 41% have discrepancies between latest registry entry and the outcomes presented to readers, and 14% of the trials had changes ‘hidden’ within the registry, with no visible discrepancy between the latest entry and the publication. These ‘hidden’ discrepancies were major in 4% of trials. An inspection of only the latest registry entry alongside the publication, without assessment of the entire registration history, would miss a primary outcome change, which is often major, in one in seven trials. We used a comparatively large sample of German clinical trials registered between 2009 and 2017, with a validated set of corresponding results publications for registry entries, determined by an extensive manual screening process (31,32). Our methodology allowed us to detect changes to registered primary outcomes that might have gone unnoticed by other studies, by retrieving all historical versions for trials, and detecting changes using a streamlined workflow. This is different from previous studies, which instead used manual searches (29,30). Many trials in our sample had changes to the registry after study completion (9%) or after publication of the first results paper (8%). The changes were almost never reported in the paper. We revealed potential indicators for these practices, with trials that were registered earlier, trials registered on [ClinicalTrials.gov](http://ClinicalTrials.gov), and industry-sponsored trials having a higher likelihood of within-registry outcome discrepancies.

Assessments of outcome changes that rely on a single version of registry entries might underestimate the true prevalence of discrepancies. The ICMJE policy states that any changes to the registration should be explained by authors in the publication (4). Both the observed lack of reporting on outcome discrepancies in results publications, as well as survey results among manuscript reviewers (6), indicate that reviewers check the registry entry of a clinical trial only in the minority of cases. While registries make change histories available and offer tools to compare different registration versions, and journal editors and reviewers in many cases use these tools to check the registration histories, the low number of reporting of discrepancies in primary outcomes suggests that this is not properly enforced. To counteract, journals could implement editorial policies that do require editors, peer reviewers, or other personnel to assess the historical versions of submitted clinical trials. Clinical trial registries, on the other hand, could help by implementing solutions to identify and mark trials with major discrepancies in their outcomes.

Still, some trials change their outcomes at two or even three different timepoints over the course of the trial. Interestingly, we found not only cases in which primary outcomes gained more detail, but also cases in which primary outcomes were described with less detail than before. Overall, we found 55% of trials to have some form of outcome change over the course of the study. This is somewhat higher compared to other studies, which exhibit a large range for the frequency, with a median of 31% (Interquartile Range: 17-45 % (7)). This might be due to different methodology, samples, timepoints, or definition of outcome discrepancies. A common reference used in other assessments of outcome discrepancies is the study by Chan et al. (35) that used a more narrow definition of outcome changes (roughly corresponding to our ‘major’ category). We used a relatively liberal definition of primary outcome changes, defining added or omitted specificity as minor discrepancies. This study has several limitations. First, we rely on the reporting quality of published studies. In 48 out of 292 publications, the primary outcome was not explicitly mentioned in the publication, so we had to take the outcome used for sample size calculation or the first reported outcome instead. A sensitivity analysis excluding these 48 studies supported our main analysis. Second, the categorisation of outcome changes is somewhat subjective, and while the agreement was very high for the within-registry changes (κ = 0.81), it was moderate (κ = 0.46) for the registration-publication ratings due to the added complexity of identifying the correct outcome as ‘primary’. However, both conflicting primary outcome definitions and conflicting ratings were resolved in discussions between the reviewers, and excluding unclear situations in the abovementioned sensitivity analysis did not change the main findings. Third, although we used high quality underlying data reflecting German clinical research output, we only assess a single geographic area, partly reflecting EU/German registration policies. Finally, we only looked at changes between registry entries but did not check how many outcome measures that show no change remain underspecified (e.g., no information on the type of measurement, timing, or method of aggregation).

Overall, our analysis did not only reveal these research findings but also demonstrated the feasibility of an efficient workflow (33) that can be used for future projects and overcome previously described challenges to incorporate historical registration data (42).

## Conclusion

Primary outcome discrepancies are very common in clinical research. Such discrepancies are often hidden in the trial registries and almost never reported in publications. The problem seems to be ubiquitous, but may be more common in older trials, trials registered in [ClinicalTrials.gov](http://ClinicalTrials.gov), and industry-sponsored trials. Even though trial registries can be an important tool to detect outcome discrepancies, review procedures employed by journals seem to rarely make use of them. Our approach provides a feasible approach to further investigate this issue. Overall, it is not sufficient to only assess the publication and latest registry entry – a careful assessment of the full research conduct from conception to publication is needed to ensure trustworthy evidence for clinical decisions.

## Supporting information

Supplementary Materials [[supplements/286182_file02.docx]](pending:yes)

## Data Availability

Analysis code and original datasets are available on Github ([https://github.com/Martin-R-H/HiddenOutcomeChanges](https://github.com/Martin-R-H/HiddenOutcomeChanges)). The final dataset has been posted to our OSF page ([https://osf.io/e2uct/](https://osf.io/e2uct/)).

[https://osf.io/e2uct/](https://osf.io/e2uct/) 

## Footnotes

*   martin.haslberger{at}bih-charite.de

*   samruddhi.yerunkar{at}charite.de

*   daniel.strech{at}bih-charite.de

*   lars.hemkens{at}usb.ch

*   benjamin.carlisle{at}bih-charite.de

*   **Previous versions:** Preliminary data of this study were presented at the 9th International Conference on Peer Review and Scientific Publication, Chicago, 9 September 2022.

*   **Code and data availability:** Analysis code and original datasets are available on Github ([https://github.com/Martin-R-H/HiddenOutcomeChanges](https://github.com/Martin-R-H/HiddenOutcomeChanges)). The final dataset has been posted to our OSF page ([https://osf.io/e2uct/](https://osf.io/e2uct/)).

*   **Ethics approval:** Not applicable.

*   **Transparency statement:** The lead authors affirm that the manuscript is an honest, accurate, and transparent account of the study being reported. No important aspects of the study have been omitted. Any discrepancies from the study as registered ([https://osf.io/t3qva](https://osf.io/t3qva)) are explained in a registration amendment ([https://osf.io/qtd2b](https://osf.io/qtd2b)). Most importantly, due to the complexity of the project and the large amount of manual screening involved, we decided to split the preregistered project in two standalone projects (outcome discrepancies and spin), which we report in separate publications. The authors declare no conflicts of interest.

*   **Role of the funding source**: This work was funded under a grant from the Federal Ministry of Education and Research of Germany (Bundesministerium fuer Bildung und Forschung – BMBF) [01PW18012]. The funder was not involved in the study design, data collection, analysis, or interpretation, writing of the manuscript, or the decision to submit for publication.

*   **Patient and Public Involvement statement:** No patients were involved in this study. There was no public involvement for this study.

*   **Dissemination to participants and related patient and public communities:** Not applicable.

*   Received February 20, 2023.
*   Revision received February 20, 2023.
*   Accepted February 21, 2023.


*   © 2023, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/)

## References

1.  1.Zarin DA, Keselman A. Registering a clinical trial in [ClinicalTrials.gov](http://ClinicalTrials.gov). Chest. 2007 Mar;131(3):909–12.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1378/chest.06-2450&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17303677&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000245072900045&link_type=ISI) 

2.  2.Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, et al. CONSORT 2010 Explanation and Elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ. 2010 Mar 23;340(mar23 1):c869–c869.
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE2OiIzNDAvbWFyMjNfMS9jODY5IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDIvMjEvMjAyMy4wMi4yMC4yMzI4NjE4Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

3.  3.Simmons JP, Nelson LD, Simonsohn U. False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant. Psychol Sci. 2011 Nov;22(11):1359–66.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0956797611417632&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22006061&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

4.  4.ICMJE. International Committee of Medical Journal Editors Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals [Internet]. [cited 2021 Oct 18]. Available from: [http://www.icmje.org/icmje-recommendations.pdf](http://www.icmje.org/icmje-recommendations.pdf)
    
    

5.  5.WMA. World Medical Association: Declaration of Helsinki - Ethical Principles for Medical Research involving Human Subjects [Internet]. 2018. Available from: [https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/](https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/)
    
    

6.  6.1.  Smalheiser NR, editor
    
    Mathieu S, Chan AW, Ravaud P. Use of Trial Register Information during the Peer Review Process. Smalheiser NR, editor. PLoS ONE. 2013 Apr 10;8(4):e59910.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0059910&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23593154&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

7.  7.Jones CW, Keil LG, Holland WC, Caughey MC, Platts-Mills TF. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015 Dec;13(1):282.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12916-015-0520-3&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26581191&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

8.  8.1.  Sim I, editor
    
    Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial Publication after Registration in [ClinicalTrials.gov](http://ClinicalTrials.gov): A Cross-Sectional Analysis. Sim I, editor. PLoS Med. 2009 Sep 8;6(9):e1000144.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pmed.1000144&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19901971&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

9.  9.Smith SM, Wang AT, Pereira A, Chang DR, McKeown A, Greene K, et al. Discrepancies between registered and published primary outcome specifications in analgesic trials: ACTTION systematic review and recommendations. Pain. 2013 Dec;154(12):2769–74.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.pain.2013.08.011&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23962590&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000327596200028&link_type=ISI) 

10. 10.Bourgeois FT. Outcome Reporting Among Drug Trials Registered in [ClinicalTrials.gov](http://ClinicalTrials.gov). Ann Intern Med. 2010 Aug 3;153(3):158.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7326/0003-4819-153-3-201008030-00006&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20679560&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000280557600004&link_type=ISI) 

11. 11.Chahal J, Tomescu SS, Ravi B, Bach BR, Ogilvie-Harris D, Mohamed NN, et al. Publication of Sports Medicine–Related Randomized Controlled Trials Registered in [ClinicalTrials.gov](http://ClinicalTrials.gov). Am J Sports Med. 2012 Sep;40(9):1970–7.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0363546512448363&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22679295&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

12. 12.Gandhi R, Jan M, Smith HN, Mahomed NN, Bhandari M. Comparison of published orthopaedic trauma trials following registration in [ClinicalTrials.gov](http://ClinicalTrials.gov). BMC Musculoskelet Disord. 2011 Dec;12(1):278.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1471-2474-12-278&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22151841&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

13. 13.Killeen S, Sourallous P, Hunter IA, Hartley JE, Grady HLO. Registration Rates, Adequacy of Registration, and a Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials Published in Surgery Journals. Ann Surg. 2014 Jan;259(1):193–6.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/SLA.0b013e318299d00b&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23732270&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

14. 14.Li XQ, Yang GL, Tao KM, Zhang HQ, Zhou QH, Ling CQ. Comparison of registered and published primary outcomes in randomized controlled trials of gastroenterology and hepatology. Scand J Gastroenterol. 2013 Dec;48(12):1474–83.
    
    

15. 15.Rosenthal R, Dwan K. Comparison of Randomized Controlled Trial Registry Entries and Content of Reports in Surgery Journals. Ann Surg. 2013 Jun;257(6):1007–15.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/SLA.0b013e318283cf7f&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23478520&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

16. 16.Wildt S, Krag A, Gluud L. Characteristics of randomised trials on diseases in the digestive system registered in [ClinicalTrials.gov](http://ClinicalTrials.gov): a retrospective analysis. BMJ Open. 2011 Oct 27;1(2):e000309– e000309.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiMS8yL2UwMDAzMDkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMy8wMi8yMS8yMDIzLjAyLjIwLjIzMjg2MTgyLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

17. 17.Becker JE, Krumholz HM, Ben-Josef G, Ross JS. Reporting of results in [ClinicalTrials.gov](http://ClinicalTrials.gov) and high-impact journals. JAMA. 2014 Mar 12;311(10):1063–5.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2013.285634&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24618969&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

18. 18.Hartung DM, Zarin DA, Guise JM, McDonagh M, Paynter R, Helfand M. Reporting Discrepancies Between the [ClinicalTrials.gov](http://ClinicalTrials.gov) Results Database and Peer-Reviewed Publications. Ann Intern Med. 2014 Apr 1;160(7):477.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7326/M13-0480&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24687070&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000334093800005&link_type=ISI) 

19. 19.Ewart R, Lausen H, Millian N. Undisclosed Changes in Outcomes in Randomized Controlled Trials: An Observational Study. Ann Fam Med. 2009 Nov 1;7(6):542–6.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiNy82LzU0MiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIzLzAyLzIxLzIwMjMuMDIuMjAuMjMyODYxODIuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

20. 20.Nankervis H, Baibergenova A, Williams HC, Thomas KS. Prospective Registration and Outcome-Reporting Bias in Randomized Controlled Trials of Eczema Treatments: A Systematic Review. J Invest Dermatol. 2012 Dec;132(12):2727–34.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/jid.2012.231&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22832489&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000311778100011&link_type=ISI) 

21. 21.Jones CW, Misemer BS, Platts-Mills TF, Ahn R, Woodbridge A, Abraham A, et al. Primary outcome switching among drug trials with and without principal investigator financial ties to industry: a cross-sectional study. BMJ Open. 2018 Feb 8;8(2):e019831.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiOC8yL2UwMTk4MzEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMy8wMi8yMS8yMDIzLjAyLjIwLjIzMjg2MTgyLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

22. 22.Jones CW, Platts-Mills TF. Quality of Registration for Clinical Trials Published in Emergency Medicine Journals. Ann Emerg Med. 2012 Oct;60(4):458-464.e1.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.annemergmed.2012.02.005&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22503374&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

23. 23.Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials. JAMA. 2009 Sep 2;302(9):977.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2009.1242&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19724045&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000269444900023&link_type=ISI) 

24. 24.Hannink G, Gooszen HG, Rovers MM. Comparison of Registered and Published Primary Outcomes in Randomized Clinical Trials of Surgical Interventions. Ann Surg. 2013 May;257(5):818–23.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/SLA.0b013e3182864fa3&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23407296&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

25. 25.Milette K, Roseman M, Thombs BD. Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: A systematic review. J Psychosom Res. 2011 Mar;70(3):205–17.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jpsychores.2010.09.015&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21334491&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

26. 26.Walker KF, Stevenson G, Thornton JG. Discrepancies between registration and publication of randomised controlled trials: an observational study. JRSM Open. 2014 May 1;5(5):204253331351768.
    
    

27. 27.Pinto RZ, Elkins MR, Moseley AM, Sherrington C, Herbert RD, Maher CG, et al. Many Randomized Trials of Physical Therapy Interventions Are Not Adequately Registered: A Survey of 200 Published Trials. Phys Ther. 2013 Mar 1;93(3):299–309.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToicHRqb3VybmFsIjtzOjU6InJlc2lkIjtzOjg6IjkzLzMvMjk5IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDIvMjEvMjAyMy4wMi4yMC4yMzI4NjE4Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

28. 28.Anand V, Scales DC, Parshuram CS, Kavanagh BP. Registration and design alterations of clinical trials in critical care: a cross-sectional observational study. Intensive Care Med. 2014 May;40(5):700–22.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s00134-014-3250-7&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24737256&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

29. 29.1.  Siegfried N, editor
    
    Huić M, Marušić M, Marušić A. Completeness and Changes in Registered Data and Reporting Bias of Randomized Controlled Trials in ICMJE Journals after Trial Registration Policy. Siegfried N, editor. PLoS ONE. 2011 Sep 21;6(9):e25258.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0025258&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21957485&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

30. 30.Pranić S, Marušić A. Changes to registration elements and results in a cohort of [ClinicalTrials.gov](http://ClinicalTrials.gov) trials were not reflected in published articles. J Clin Epidemiol. 2016 Feb;70:26–37.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2015.07.007&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26226103&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

31. 31.Riedel N, Wieschowski S, Bruckner T, Holst MR, Kahrass H, Nury E, et al. Results dissemination from completed clinical trials conducted at German university medical centers remained delayed and incomplete. The 2014 –2017 cohort. J Clin Epidemiol. 2022 Apr;144:1–7.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2021.12.012&link_type=DOI) 

32. 32.Wieschowski S, Riedel N, Wollmann K, Kahrass H, Müller-Ohlraun S, Schürmann C, et al. Result dissemination from clinical trials conducted at German university medical centers was delayed and incomplete. J Clin Epidemiol. 2019 Nov;115:37–45.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2019.06.002&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

33. 33.1.  Naudet F, editor
    
    Carlisle BG. Analysis of clinical trial registry entry histories using the novel R package cthist. Naudet F, editor. PLOS ONE. 2022 Jul 1;17(7):e0270909.
    
    

34. 34.Scimago Journal & Country Rank [Internet]. 2022 [cited 2022 Oct 31]. Available from: [https://www.scimagojr.com/journalrank.php](https://www.scimagojr.com/journalrank.php)
    
    

35. 35.Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical Evidence for Selective Reporting of Outcomes in Randomized Trials: Comparison of Protocols to Published Articles. JAMA. 2004 May 26;291(20):2457.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.291.20.2457&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15161896&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000221599700028&link_type=ISI) 

36. 36.Zarin DA, Tse T, Williams RJ, Califf RM, Ide NC. The [ClinicalTrials.gov](http://ClinicalTrials.gov) Results Database — Update and Key Issues. N Engl J Med. 2011 Mar 3;364(9):852–60.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMsa1012065&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21366476&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000287928400010&link_type=ISI) 

37. 37.Carlisle BG. Numbat {S}ystematic {R}eview {M}anager [Internet]. Berlin: The Grey Literature; 2014. Available from: [https://numbat.bgcarlisle.com](https://numbat.bgcarlisle.com)
    
    

38. 38.R Core Team. R: A language and environment for statistical computing. [Internet]. Vienna, Austria: R Foundation for Statistical Computing; 2022. Available from: [https://www.R-project.org/](https://www.R-project.org/)
    
    

39. 39. Elm E von, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. The Lancet. 2007 Oct 20;370(9596):1453–7.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/s0140-6736(07)61602-x&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

40. 40.Alberer M, Burchard G, Jelinek T, Reisinger E, Beran J, Meyer S, et al. Co-administration of a meningococcal glycoconjugate ACWY vaccine with travel vaccines: A randomized, open-label, multi-center study. Travel Med Infect Dis. 2014 Sep;12(5):485–93.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.tmaid.2014.04.011&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24873986&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F02%2F21%2F2023.02.20.23286182.atom) 

41. 41.Wiegand A, Sommer A, Nieratschker V, Plewnia C. Improvement of cognitive control and stabilization of affect by prefrontal transcranial direct current stimulation (tDCS). Sci Rep. 2019 Dec;9(1):6797.
    
    

42. 42.Al-Durra M, Nolan RP, Seto E, Cafazzo JA. Prospective registration and reporting of trial number in randomised clinical trials: global cross sectional study of the adoption of ICMJE and Declaration of Helsinki recommendations. BMJ. 2020 Apr 14;m982.