Efficacy of acupuncture and acupressure for the treatment of Raynaud’s syndrome: Protocol for a meta-analysis of randomized controlled trials

Types of Participants

We will include all patients who have been diagnosed with Raynaud’s syndrome. We will not place restrictions on age, gender or disease durations.

Types of Interventions

We will include all studies that include the use of any acupuncture or acupressure techniques (including, but not limited to: electroacupuncture and warm-needle acupuncture). If other treatments are used to supplement the acupuncture therapy, the treatments used must be consistent between treatment arms (i.e. acupuncture + concurrent treatment vs. concurrent treatment only).

Types of Studies

We will include randomized and quasi-randomized parallel-groups RCTs.

Cold Water Immersion Test (n)

We will examine incidences of a positive cold water immersion test (onset of Raynaud’s symptoms after immersion in cold water) and incidences of temperature recovery from a cold water immersion test (temperature recovered to normal levels after a cold water test, within a predefined time period). These information should be collected at the latest follow up.

Incidence of Improvement or Remission (n)

We will examine incidences of symptom improvement or remission after acupuncture or acupressure, defined as per individual study criteria.

Number of Attacks Per Day (n±SD)

We will examine the mean number of attacks per day, collected at the latest follow up.

Nailfold Capillaroscopy: Number of Patients with Deformed Capillaries (n)

We will examine the number of patients with deformed capillaries, as examined via nailfold capillaroscopy, at the latest follow up.

Nailfold Capillaroscopy: Number of Patients with Reduced Capillary Flow (n)

We will examine the number of patients with reduced capillary flow, defined as per individual criteria. The patients should be examined using nailfold capillaroscopy at the latest follow up.

Nailfold Capillaroscopy: Number of Patients with Low Capillary Density (n)

We will examine the number of patients with low capillary density, as examined via nailfold capillaroscopy at the latest follow up.

Electronic Database Search

We will conduct a database search of MEDLINE, EMBASE, Web of Science, CINAHL, and CENTRAL from inception to January 2020. We will use relevant MeSH headings to ensure appropriate inclusion of titles and abstracts (see Table 1 for search strategy).

Major Chinese databases, including Wanfang Data, Wanfang Med Online, CNKI, and CQVIP will also be searched using a custom Chinese search strategy (see Table 2 for search strategy).

Other Data Sources

We will also conduct hand search the reference list of previous meta-analyses and NMAs for included articles.

Study Selection

We will perform title and abstract screening independently and in duplicate using Rayyan QCRI (https://rayyan.qcri.org). Studies will only be selected for full-text screening if both reviewers deem the study relevant. Full-text screening will also be conducted in duplicate. We will resolve any conflicts via discussion and consensus or by recruiting a third author for arbitration.

Data Collection

We will carry out data collection independently and in duplicate using data extraction sheets developed a priori. We will resolve discrepancies by recruiting a third author to review the data.

Risk of Bias

We will assess risk of bias (RoB) independently and in duplicate using The Cochrane Collaboration’s tool for assessing risk of bias in randomized trials[2]. Two reviewers will assess biases within each article in seven domains: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, selective reporting, and other biases.

If a majority of domains are considered to be low risk, the study will be assigned a low RoB. Similarly, if a majority of domains are considered to be high risk, the study will be assigned a high RoB. If more than half of the domains have unclear risk or if there are an equivalent number of low and high, low and unclear or high and unclear domains, the study will be assigned an unclear RoB.

Bibliometric Data

Authors, year of publication, trial registration, digital object identifier (DOI), publication journal, funding sources and conflict of interest.

Methodology

# of participating centers, study setting, blinding methods, phase of study, enrollment duration, randomization and allocation methods, criteria for remission.

Baseline Data

# randomized, # analyzed, mean age, sex, follow up duration.

Outcome Related Data

Please see the Outcomes section.

Meta-Analysis

We will conduct all statistical analyses using R 4.0.0[3]. We will perform meta-analyses using the meta library. Because we expect significant heterogeneity among studies due to differences in methodology, we will use a random effects model[4].

For dichotomous outcomes, we will report the results of the analyses as risk ratio (RR), pooled using the Mantel-Haenszel method[5], with 95% confidence intervals (CIs) with Hartung-Knapp adjustment for random effects model[6]. For continuous outcomes, we will report the results as mean differences (MDs), pooled using the inverse variance method[7], with corresponding 95% CIs with Hartung-Knapp adjustment for random effects model[6]. We used the Sidik-Jonkman estimator[6,7] for τ² calculations, and we used the Q-profile method[8] for estimating the confidence interval of τ² and τ.

Missing Data

We will attempt to contact the authors of the original studies to obtain missing or unpublished data. We will attempt to impute standard deviation values if not provided by the study.

Heterogeneity Assessment

We will assess statistical heterogeneity using I² statistics, τ² and Cochran’s Q[9]. We will identify the source of heterogeneity by

1. identify outlier studies with treatment effect that is not included in the 95% confidence interval of the pooled effect size using the dmetar library;

2. perform influence analyses, or the “leave-one-out” analysis, where the meta-analysis is repeated with one study omitted, using the dmetar library;

3. Perform GOSH analyses[10] using the metafor library. The GOSH plot will be examined for evaluable clusters, and gosh.diagnostics function will be used to identify the outlying studies if there are evaluable clusters.

We will perform sensitivity analyses excluding outlier studies to observe the outliers’ effects on the original pooled effect size and heterogeneity measures.

Publication Bias

We will use funnel plots[11] to detect the presence of small study effects. We will use Egger’s test[12] to check for asymmetry within the funnel plot to identify possible publication bias. If Egger’s test reveals significant publication bias, we will use the trim-and-fill method[13] to estimate the actual effect size with imputations of the missing small studies. This will be done using the trimfill method in the meta library.

We will also perform p-curve [14] analyses to detect the presence of “p-hacking” [15] using the dmetar library. We will report whether we observed evidence of “p-hacking”, such as a lack of right skew in the p-curve plot or low estimated statistical power.

Meta-Regression

We will perform meta-regression on:

1. % of patients with primary/secondary Raynaud’s syndrome

2. gender (% female patients)

3. follow up periods