Abstract
Objectives To examine heterogeneity of outcomes in protocols of clinical trials of Coronavirus Disease 2019 (COVID-19) and to identify outcomes for prioritization in developing a core outcome set (COS) in this field.
Design This study is a review.
Data sources Databases of ICMJE-accepted clinical trial registry platform were searched on February 14, 2020.
Eligibility Criteria Randomized controlled trials (RCTs) and non-RCTs of COVID-19 were considered. Conditions of patients include common type, severe type or critical type. Interventions include traditional Chinese medicine (TCM) and Western medicine. We excluded trials that for discharged patients, psychological intervention and complications of COVID-19.
Data extraction and synthesis The general information and outcomes, outcome measurement instruments and measurement times were extracted. The results were analysed by descriptive analysis.
Results 19 registry platforms were searched. A total of 97 protocols were included from 160 protocols. For protocols of TCM clinical trials, 76 outcomes from 16 outcome domains were reported, and almost half (34/76, 44.74%) of outcomes were reported only once; the most frequently reported outcome was time of SARS-CoV-2 RNA turns to negative. 27 (27/76, 35.53%) outcomes were provided one or more outcome measurement instruments. 10 outcomes were provided one or more measurement time frame. For protocols of western medicine clinical trials, 126 outcomes from 17 outcome domains were reported; almost half (62/126, 49.21%) of outcomes were reported only once; the most frequently reported outcome was proportion of patients with negative SARS-CoV-2. 27 outcomes were provided one or more outcome measurement instruments. 40 (40/126, 31.75%) outcomes were provided one or more measurement time frame.
Conclusion Outcome reporting in protocols of clinical trials of COVID-19 is inconsistent. Thus, developing a core outcome set is necessary.
Strengths and limitations of this study
1. This review is the first to describe variation in outcomes, outcome measurement instruments and outcome measurement time reporting in clinical trials for Coronavirus Disease 2019 (COVID-19).
2. All the database of ICMJE-accepted clinical trial registry platform were searched, and randomized controlled trials and observational studies were considered.
4. The aim of this review was to provide a list of outcomes for clinical trials of COVID-19, both interventions of Traditional Chinese Medicine and western medicine were considered.
5. When the searching was conducted, no clinical trials were registered by countries out of China, so all of included protocols were from China.
INTRODUCTION
Since the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection occurred in Wuhan, Hubei Province from December 2019, the disease, which was named as Coronavirus Disease 2019 (COVID-19) by World Health Organization (WHO) on February 12, 2020. According to the website of National Health Commission of the People’s Republic of China (NHC-PRC), 77,658 confirmed cases have been reported from all areas of China until 0 o’clock, February 25, 2020. 27,323 cured patients discharged, 2,663 patients died [1]. On the website of WHO showed that 2559 confirmed cases have been reported in 33 countries out of China, 34 patients died at 10AM CET, February 25 2020 [2].
However, there is still no specific medicine for COVID-19 now. In China, the government encourages traditional Chinese medicine (herbal medicine, moxibustion, Baduanjin, etc.) to take an important role in clinical practice. The NHC-PRC and National Administration of Traditional Chinese Medicine (NATCM) have released the Version 6.0 of Diagnosis and Treatment Guideline for COVID-19 (informal version) on February 18, 2020 [3]. The guideline recommended general therapy methods, such as oxygen support, or trying to use alpha-interferon, Lopinavir/Ritonavir, Ribavirin, Chloroquine phosphate, Abidol, etc. For severe and critical type of disease, high flow nasal catheter oxygen therapy, invasive or non-invasive mechanical ventilation, extracorporeal membrane oxygenation (ECMO), plasma of survivors, glucocorticoid, plasma exchange or according to the patients’ situation. The guideline also recommended TCM therapy methods, including herbal medicine formulas and proprietary Chinese medicine according to TCM syndromes, which are analyzed by clinical symptoms and signs through four methods of diagnosis: inspection, auscultation and olfaction, interrogation, and palpation.
At the same time, an increasing number of clinical trials are conducting. After searching some protocols of clinical trials from Chinese Clinical Trial Registry (ChiTCR) and ClinicalTrials.gov, we found that different researchers chose different outcomes. It is very important for clinical trials to provide evidence in treating COVID-19. However, the heterogeneity of outcomes make it impossible to conduct meta-analysis in the future, which may reduce the value of clinical trials and improve waste.
We are going to develop a core outcome set (COS) for clinical trials of COVID-19. The study have been registered in Core Outcome Measures in Effectiveness Trials (COMET) database [4]. The first clinical trial of COVID-19 was registered on January 23, 2020 [5]. When we registered the COS study, there were about 50 clinical trials registered [4]. On February 25, 2020, the number of registered trials increased to 297. Before we finish the COS, we believe that it is very important to draw researchers’ attention to concern about outcomes in their research. So we conducted a review of outcome reporting from registered clinical trials of COVID-19. Because TCM and western medicine take the same role in the treatment of COVID-19 in China, so the review includes both interventions.
METHODS
Search strategy
All the databases of ICMJE-accepted clinical trial registry platform [6] were considered. Search terms for ChiCTR included “COVID-19”, “2019-novel Corona Virus (2019-nCoV)”, “Novel Coronavirus Pneumonia (NCP)”, “Severe Acute Respiratory Infection (SARI)”, “Severe Acute Respiratory Syndrome - Corona Virus-2 (SARS-CoV-2)”. Search terms for Netherlands National Trial Register (NTR) included “nCoV”, “Coronavirus”, “SARS”, “SARI”, “NCP”, “COVID”. Search terms for other databases included “2019-nCoV OR Novel Coronavirus OR New Coronavirus OR SARS-CoV-2 OR SARI OR NCP OR Novel Coronavirus Pneumonia OR COVID-19 OR Wuhan pneumonia”. The searching conducted on n February 14, 2020.
Inclusion criteria
The population should include conformed patients of COVID-19.
Patients’ conditions include common type, severe type or critical type.
The interventions include any type of TCM therapy or western therapy.
The study types include randomized controlled trial (RCT) and observation study.
Exclusion criteria
Studies for discharged patients.
Studies for psychological intervention.
Studies for complications of COVID-19.
Study identification
Two reviewers (RQ and XW) independently assessed all the registered protocols. Any disagreement was resolved by discussion.
Date extraction
Two reviewers (RQ and MZ) independently extracted information. The information included the primary investigators’ name, study type, type of disease, primary sponsor, number of settings, sample size, population’s age, course of treatment, interventions, outcomes, outcome definition/measurement instruments, measurement time frame. Any disagreement was resolved by discussion.
Merging outcomes and grouping under outcome domains
Two researchers (RQ and CZ) merged the overlapping outcomes according to the definition of outcomes independently. If the researchers did not provide definition of outcome, they discussed and achieved consensus if necessary. For example, “PaO2/FiO2”, “oxygenation index”, “oxygen index”, “the difference of PaO2/FiO2 between two groups” were aggregated as “PaO2/FiO2”. Many protocols presented composite outcomes. If definitions were provided, or all of the single outcomes in the composite one can be measured in one test, it was listed in the review. If a single outcome which belongs to a composite outcome was reported by one or more protocols, the composite outcome was removed from the review. But when we conduct Delphi survey in further research, the composite outcome will be list to consult the participants’ opinion.
After the original outcomes were aggregated, two researchers (RQ and CZ) grouped individual outcomes into the appropriate outcome domain together and achieved consensus. The taxonomy of outcome domains were developed by the researchers from COMET initiative [7].
Statistical analysis
The results were analysed by descriptive analysis.
Patient and public involvement
The COVID-19 is highly infectious. For the safety of patients and public, they were not involved in the design or planning of the study.
RESULTS
Characteristics of literature
In this review, a total of 160 protocols from 19 different clinical trials registry platforms were searched. After reading titles and study details, 63 non-relevant or ineligible study protocols were excluded. In the end, 97 eligible study protocols were included from ChiCTR and ClinicalTrials.gov. The searching results and inclusion numbers were shown in Table 1.
In the included protocols, 34 clinical trials were for TCM therapy and 63 clinical trials were for western medicine therapy. All of clinical trials will be conducted in China. These clinical trials include 75 RCTs (53 for western medicine and 22 for TCM medicine) and 22 non-RCTs (10 for western medicine and 12 for TCM medicine). The first registered clinical trial for western medicine was on January 23, 2020, while the first registered clinical trial for TCM medicine was on January 27, 2020. The general characteristics of the included protocols are shown in table 2 and table 3.
According to the information of primary sponsor, we found that the clinical trials were registered from 13 different provinces of China. Researchers from Hubei province registered more clinical trials (31/97, 31.96%) than researchers from other provinces. The distribution of clinical trials is shown in Figure 1.
The list of outcomes
In protocols of TCM clinical trials, the number of primary outcomes are from 1 (13/34, 38.24%) to 13 (1/34, 2.94%), the number of secondary outcomes are from 1 (7/34, 20.59%) to 14 (1/34, 2.94%). 1(1/34, 2.94%) protocol of clinical trial reports other outcomes. For individual clinical trial, the number of outcomes are from 1 (2/34, 5.88%) to 15 (1/34, 2.94%). The number of outcomes in protocols of TCM clinical trials is shown in Figure 2.
In protocols of western medicine clinical trials, the number of primary outcomes are from 1 (39/63, 61.90%) to 10 (1/63, 1.59%), the number of secondary outcomes are from 0 (8/63, 12.70%) to 15(1/63, 1.59%). 5 (5/63, 7.94%) protocols of clinical trials reported other outcomes (the number of outcomes are from 1 to 5). For individual clinical trial, the number of outcomes are from 1 (4/63, 6.35%) to 16 (1/63, 1.59%). The number of outcomes in protocols of western medicine clinical trials is shown in Figure 3.
After merging and grouping outcomes, there are 76 different outcomes from 16 outcome domains in 34 protocols of TCM clinical trials (table 4). Almost half of outcomes are reported only once (34/76, 44.74%). The most frequently reported outcome is “time of SARS-CoV-2 RNA turns to negative”, which is reported 16 times. Only 3 (3/76, 3.95%) outcomes are reported more than 10 times. Only 27 (27/76, 35.53%) outcomes are provided one or more outcome measurement instruments. Only 10 outcomes are provided one or more measurement time frame. The summary of outcome reporting for protocols of TCM clinical trials is shown in Figure 4.
In the 16 outcome domains of protocols of TCM clinical trials, 4 outcome domains (adverse events/effects, hepatobiliary outcomes, mortality/survival, psychiatric outcomes) consisted of only one outcome. These outcomes are reported between 1 and 9 times, and the median outcome reporting time was 6.5. Respiratory, thoracic and mediastinal outcomes have the largest number of outcomes, which includes 17 outcomes; chest imaging is reported more frequently than other outcomes. The number of outcomes in different outcome domains in protocols of TCM clinical trials is shown in Figure 5.
After merging and grouping, there are 126 different outcomes from 17 outcome domains in 63 protocols of western medicine clinical trials (table 5). Almost half of outcomes are reported only once (62/126, 49.21%). The most frequently reported outcome is “proportion of patients with negative SARS-CoV-2”, which is reported 40 times. Only 11 (11/126, 8.73%) outcomes are reported more than 10 times. Only 27 outcomes are provided one or more outcome measurement instruments. Only 40 (40/126, 31.75%) outcomes are provided one or more measurement time frame. The summary of outcome reporting for protocols of TCM clinical trials is shown in Figure 6.
In the 17 outcome domains of protocols of western medicine clinical trials, 5 outcome domains (adverse events/effects, delivery of care, economic, metabolism and nutrition outcomes, mortality/survival) consisted of only one outcome. These outcomes are reported between 1 and 36 times, and the median outcome reporting time is 1. Respiratory, thoracic and mediastinal outcomes included the largest number of outcomes, which includes 31 outcomes; chest imaging is reported more frequently than other outcomes. The number of outcomes in different outcome domains in protocols of western medicine clinical trials is shown in Figure 7.
DISCUSSION
This review is the first to evaluate the outcome reporting of protocols of TCM and western medicine clinical trials for treating COVID-19. The results showed variations in the outcome reporting. For outcome measurement instruments/outcome definitions and outcome measurement time, there is also heterogeneity. However, many primary investigators did not provide outcome measurement instruments/outcome definitions or outcome measurement time. It is difficult to predict results of clinical trials now. But it is obvious that these problems may result in the exclusion of some studies from systematic reviews/meta-analyses due to the heterogeneity of outcomes or outcome measurements. It is a waste.
In this review, we find that there are more than 40 duplicated outcomes between protocols of TCM and western medicine clinical trials. No matter for clinical trials of TCM or western medicine, etiological test, chest imaging, respiratory symptoms, temperature, mortality/survival and adverse events are very important. These outcomes are relevant to the prognosis of disease and safety of therapy.
Because of no specific therapy can be used in the treatment of COVID-19, it is necessary and urgent to conduct clinical trials, no matter what the interventions are. We believe that it is important to develop a COS for clinical trials of TCM and western medicine for treating COVID-19, so that the efficacy of different interventions can be compared and merged in systematic review/meta-analysis.
Data Availability
The data is from public database and does not include identifiable patient data.
Contributors
RQ and HS contributed to the study design. XW and MZ conducted searching and extracted data from databases. RQ, CZ, JH, YH, TH contributed to the data analysis. RQ drafted the manuscript. ML, HS, CZ, JC, HS revised the manuscript. All authors read and approved the final manuscript
Funding
This work was supported by the National High-level Personnel of Special Support Program [W02020052].
Competing interests
The authors declare that there is no conflict of interest.
Patient consent
Not required.
Data sharing statement
The data is from public database and does not include identifiable patient data.
References
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.↵
- 6.↵
- 7.↵
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27.
- 28.
- 29.
- 30.
- 31.
- 32.
- 33.
- 34.
- 35.
- 36.
- 37.
- 38.
- 39.
- 40.
- 41.
- 42.
- 43.
- 44.
- 45.
- 46.
- 47.
- 48.
- 49.
- 50.
- 51.
- 52.
- 53.
- 54.
- 55.
- 56.
- 57.
- 58.
- 59.
- 60.
- 61.
- 62.
- 63.
- 64.
- 65.
- 66.
- 67.
- 68.
- 69.
- 70.
- 71.
- 72.
- 73.
- 74.
- 75.
- 76.
- 77.
- 78.
- 79.
- 80.
- 81.
- 82.
- 83.
- 84.
- 85.
- 86.
- 87.
- 88.
- 89.
- 90.
- 91.
- 92.
- 93.
- 94.
- 95.
- 96.
- 97.
- 98.
- 99.
- 100.
- 101.
- 102.
- 103.