Abstract
Background An increasing number of acupuncture clinical trials are being registered, but the reports of results and data transparency are unclear. This paper aims to analyze and evaluate the current state of registration and reports of acupuncture clinical studies and seek feasible solutions to improve the quality of acupuncture clinical studies, leading to minimizing waste of public resources and effectively providing a reliable evidence-based basis for clinical practice.
Methods This paper will focus on the acupuncture clinical trials that met the criteria in relevant studies registered and published during the period between 1 Jan 2013 to 31 Dec 2021.The search and registration platforms were the Clinicaltrials.gov and the Chinese Clinical Trial Registry (ChiCTR). The literature search platforms were Web of Science, PubMed, CNKI, WanFang, VIP, and China Biomedical Literature Database (SinoMed).
Results A total of 403 trials were included in ChiCTR and 519 trials were included in Clinicaltrials.gov. The overall reporting rate of acupuncture clinical trial results from the two registration centres was was 25%. Clinicaltrials.gov reporting rate was 12% and that from ChiCTR was 41%.
Conclusion The number of acupuncture clinical trial registrations is steadily increasing, but the reporting rate of trial results is relatively low and the transparency of data is not ideal. Due to the fact that the unavailability of the registered trial results caused a waste of research resources and funds, there is a shortage of research in the relevant area. Therefore, first of all, researchers should put more attention on clinical trial reports in acupuncture and respect science; secondly, it is recommended to set up a research progress tracker on registration platforms accessible to the public users, which contributes to the supervision of research projects; at the same time, the journal is suggested that also adjust the evaluation criteria for reporting the negative results to reduce the probability of results bias; most importantly, the government is recommended to optimize the closing review, strengthen the monitoring of core outcome indicators, standardize clinical reports to reduce the waste of public resources.
Introduction
Clinical trial registration means that specific information about a trial needs to be prospectively registered in a web-based publicly accessible database [1]. Since the International Committee of Medical Journal Editors (ICMJE) announced in 2004 that clinical trials must be registered to be considered for publication [2], there has been an increasing emphasis on the regulation of acupuncture clinical trial registration to reduce the duplication of research [3] and to help prevent bias in reporting of results [4,5,6]. The Final Rule [7,8], which came into effect on 18 January 2017, provides further clarity on clinical trial registration and reporting requirements. The timely publication of trial data will facilitate academic communication, provide guidance on clinical practice and promote the development of evidence-based medicine [9].
After searching and collecting registered clinical trial literature, it is noticed that some of the clinical trial literature is marked with registration numbers, and some registered trials have not been published or data is unaccessable. A study has evaluated the registration and reporting of clinical trials from the start of the registry to 2013 and the results were not optimistic [10]. To further explore the current state of the number of registered clinical trials on acupuncture and their reporting in recent years, this study intends to dig deeper into the clinical trials related to acupuncture registered from 2013 to 2021, in order to discover the problems and seek possible solutions to improve the quality of clinical research.
Methods
Search strategies
Key terms, such as “needle” and “acupuncture” are searched in Chinese Clinical Trial Registry platform[11]. We select “Advanced Search” with the search term “acupuncture” in Clinicaltrials.gov[12]. The search period was set from January 1, 2013 to December 31, 2021, and the results of the search were summarized for clinical trials related to acupuncture that met the criteria. The publications were also searched on the Web of Science, PubMed, CNKI, WanFang, VIP, and China Biomedical Literature Database, in English and Chinese only.
Inclusion criteria
All clinical trials related to acupuncture (including electroacupuncture) registered between 1 January 2013 and 31 December 2021.
Exclusion criteria
Duplicate registered clinical trials.
Statistical analysis
After training three researchers responsible for the literature search (Benlu Chen, Yun Fu and Yingying Cai), data from the registered trials were extracted and summarised through an EXCEL sheet. Reporting was based on the above databases for subject terms, publication date, author, author affiliation, registration number, subject number, etc., and articles with published trial results were considered as results publication. If the publication is in the type of protocol or review, it is considered as other publication. For the extraction and searching process, if there is disagreement among three researchers, firstly, three parties should negotiate to solve the problem. If the agreement is not reached after the negotiation, then we need to seek help from experienced people or relevant experts.
Results
The results of the search are shown in Fig 1. The initial ChiCTR search of 1637 registered studies ultimately included 403 relevant clinical trials, of which 166 trials whose results have now been published. Clinicaltrials.gov’s initial search of 698 registered trials ultimately included 519 trials, of which 62 trials whose results have now been published. The results of the two centres are listed separately as there are differences in reporting and implementation of results and focuses on different issues. The state of trial registration and reporting is shown in Table 1.
Provided are abbreviations: Number of Registrations(NR), ChiCTR (C), Clinicaltrials.gov(E), Total(T), Number of Publications(NP), Mark the Registration Number(MRN), Other Publications(OP), Number of Articles(NA), Data Downloadable(DD), Published No Data Available(PNDA), Normal Completion(NC), Published in Advance(PA), Not yet Due(ND), Percentage(P).
1. Number of acupuncture clinical trial registrations
2014 witnessed the most significant increase in registrations of Clinicaltrials.gov. 2017 witnessed the most significant increase in registrations of ChiCTR and 2020 witnessed the felling.
2. Results publication rate
The total results reporting rate for acupuncture clinical trial articles in both registries was 25%. Clinicaltrials.gov reporting rate was 12% for results, same as those reports with registration numbers marked. Other types of publication accounted for 13%. ChiCTR reporting rate was 41% for results, with 21% for reporting with registration numbers clearly marked, and 7% for other types of publication.
3. Publication timeline
The majority of trials with published results were published after completion of the trial, accounting for 83%. Clinicaltrials.gov accounted for 84% of the trials registered; ChiCTR accounted for 83%.
Only 17% of the trials were published early. Of the unpublished trials, only 18% are in progress before the due date, while the rest were unpublished on due date.
4. Results data availability
Only a small proportion of trials were available on the registry website. A total of 6% is available from both registries; 8% is available from Clinicaltrials.gov; and 4% is available from ChiCTR. Data were not publicly available for 90% of the published trials. Clinicaltrials.gov was not publicly available for 87% and ChiCTR was available for 91%.
5. Study status of unpublished trials
Only the NIH clinical registry platform has records on the status of studies, of which the largest number are recruiting, completed and unknown details, respectively 108, 102 as well as 74. A small number of trials were discontinued and suspended, 12 and 2, respectively.
Discussion
1. Registration trends
The number of acupuncture clinical trial registrations in both registries has steadily increased year by year. At the beginning of 2017, The fact that the number of ChiCTR registrations are significantly higher than the previous number, and even higher than Clinicaltrials.gov, is probably related to the application to WHO ICTR made by Clinicaltrials.gov in the US in 2017 and which is approved-local applications for registration when there is a WHO ICTR-accredited Level 1 registry where the trial is conducted [13]. There is a significant drop in ChiCTR registrations in 2020, likely due to the impact of the COVID-19 and the large amount of medical resources invested in China, but this does not affect the future trend of steady growth in acupuncture clinical trial registrations. Currently, acupuncture trials are in a period of modest growth, with no peak growth performance. Therefore, emphasis should be placed on clinical innovation and talent development in acupuncture, and researchers need to broaden the disease spectrum of acupuncture to better promote the development of acupuncture.
2. Reporting situation
Concerning the reporting of trials, it is clear that the reporting rates of results from acupuncture trials registered at both centres are low, and ChiCTR has a significantly higher rate of reporting results than Clinicaltrials.gov does. This may be related to the Chengdu Declaration published in April 2006, which announced the implementation of priority publication by ChiCTRPC member journals on a case-by-case basis [14]. There is no pattern in the number of trials published in terms of year due to a small number of publications. The low reporting rate is not only due to non-reporting by investigators, but also to the following possibilities: for example, Clinicaltrials.gov has multi-national investigator registrations, and there is a possibility that having papers published on local journals or platforms may lead to restricted access; for trials registered at ChiCTR, during the search process, some articles were found to be similar to the registered content but without the registration number or ethics number to confirm. In addition, it is possible that the low reporting rate is related to outcome reporting bias [15,16,17], and studies demonstrated that publication bias is a problem that still needs to be addressed [18].
3. Data availability
The level of data availability in both centres is not satisfactory. The data availability rate at Clinicaltrials.gov is significantly higher than that at ChiCTR, indicating that Clinicaltrials.gov is more concerned with the implementation of data disclosure. However, there is still much room for improvement in this area at both centres, far from the trial reporting rate. The centres need to play their roles as supervisors and ask trials that have published results to upload their data and take appropriate action if necessary.
4. Study Status
Clinicaltrials.gov clearly identifies trial study status and requires investigators to record any changes to trial status in the relevant section of the website. The main status can be divided by a few groups are Completed, Not yet recruiting, Recruiting, Enrolling by invitation, Active, not recruiting, Suspended, Terminated, Withdrawn and Unknown. The trials with the status of Terminated and Withdrawn could be conducted to improve the limitations of study. In addition, it was found that most of the trials with the status of Completed had not been queried for publication, therefore, measures need to be taken by the registry to urge and facilitate trials with the status of Completed to report their results and make their data publicly available. This shows that the research status of trials is of critical importance. Therefore, ChiCTR should be called upon to create a new research status item, and to set the number of years of research, and to urge investigators according to their research status. Funding institutions could also refer to the NIHR to request that registration information needs to be updated during the study period [19].
5. Proposed solutions
We need to face the problem the problem of low reporting rates of registered trial results. Firstly, to avoid limited access, researchers are advised to update the published article information on the registration site after article publication; Secondly, in response to the lack of registration numbers, trial centres and major journals should call for clinical trials to be registered before publication and require registration numbers to be indicated. This will facilitate the registration of clinical trials and increase transparency, and also reduce the illusion of unpublished findings due to partial changes of trials, which can be updated on the registration website in relation to changes. Furthermore, the potential for biased reporting of results needs to be called out to journals and academics to pay more attention to the results of studies, rather than focusing on positive results. They could accept the publication of negative results or seek new ways or platforms for non-positive results. Then, funding institutions could take a model from the NIHR [16] in requiring that the date of publication of trial results be disclosed and that past registrations and publications be taken into account when reviewing funding applications for new clinical trials. More importantly, researchers are expected to pay more attention to the reporting of results and data disclosure of registered acupuncture clinical trials; and that registries will monitor the publication of reported results and timely updates in the registries. The registries shall, as far as possible, request investigators to update the progress of their trials, and shall take appropriate measures to promote the completion and reporting rate of trials that are not reported by the due date, so that research resources can be fully utilised.
6. Limitations
Limitations of this study: This paper mainly focuses on the acupuncture trials registered with Clinicaltrials.gov and ChiCTR, which may not reflect registrations and reporting from other registries, regions or countries. International studies can be carries out with global cooperation. Relevant information regarding WHO is not available which set a limit to our data. The study is based on trials registered from 1 January 2013 to 31 December 2021. Subject classification is not shown on the Clinicaltrials.gov website, hence, it is not possible to analyze the relationship between registration, reporting and subject classification.
Conclusion
The number of acupuncture clinical trial registries is increasing steadily, but the reporting rate of trial results is very low and the transparency of data is not ideal. At the same time, the unavailability of registered trial results greatly weakens the advantages of clinical trial registries, causing a waste of research resources and funds and a possible shortage of research in the corresponding fields. Therefore, firstly, it is recommended that researchers need to put more focus on acupuncture clinical trial reports with respect. Secondly, study progress can be recorded and monitored on the registration platforms which allow the public to access data. At the same time, the journal could update the evaluation criteria for evaluating negative-result reports to minimize the bias that may occur. Last but not least, funding institutions are expected to optimise the end-of-trial review, strengthen the reporting monitoring of core outcome indicators, regulate clinical research and reduce the waste of public resources.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
Author Contributions
Conceived and designed the experiments: QAZ and HJL conceived the ideas and drafted the manuscript. YF, YYC and BLC contributed to the acquisition and the analysis of data. QWZ revised the manuscript. All authors approved the final version of the manuscript accepted for publication.
Supporting Information
S1 File. Raw extraction table.
(XLS)
Acknowledgments
This work was supported by the Zhejiang Provincial Administration of Traditional Chinese Medicine (grant no. 2020ZQ026) https://wsjkw.zj.gov.cn/, and the State Administration of Traditional Chinese Medicine of the People’s Republic of China (grant no. zyycx201901) http://www.satcm.gov.cn/.