Abstract
A large number of randomized controlled trials (RCTs) on psychological interventions for adult posttraumatic stress disorder (PTSD) have been published. We aimed at providing a comprehensive quantitative summary covering short and long-term efficacy, acceptability and trial quality. We conducted systematic searches in bibliographical databases to identify RCTs examining the efficacy (standardized mean differences in PTSD severity, SMDs) and acceptability (relative risk of all-cause dropout, RR) of trauma-focused cognitive behaviour therapy (TF-CBT), Eye Movement Desensitization and Reprocessing (EMDR), other trauma-focused psychological interventions (other-TF-PIs) and non-trauma-focused psychological interventions (non-TF-PIs) compared to each other or to passive or active control conditions. Hundred-fifty-seven RCTs met inclusion criteria comprising 11,565, 4,830 and 3,338 patients at post-treatment assessment, ≤ 5 months follow-up and > 5 months follow-up, respectively. TF-CBT was by fore the most frequently examined intervention. We performed random effects network meta-analyses (efficacy) and pairwise meta-analyses (acceptability). All therapies produced large effects compared to passive control conditions (SMDs ≥ 0.80) at post-treatment. Compared to active control conditions, TF-CBT and EMDR yielded medium treatment effects (SMDs ≥ 0.50 < 0.80), and other-TF-PIs and non-TF-PIs yielded small treatment effects (SMDs ≥ 0.20 < 0.50). Interventions did not differ in their short-term efficacy, yet TF-CBT was more effective than non-TF-PIs (SMD = 0.17) and other-TF-PIs (SMD = 0.30). Results remained robust in sensitivity and outlier-adjusted analyses. Similar results were found for long-term efficacy. Interventions also did not differ in terms of their acceptability, except for TF-CBT being associated with a slightly increased risk of dropout compared to non-TF-PIs (RR=1.36; 95% CI: 1.08-1.70). In sum, interventions with and without trauma focus appear effective and acceptable in the treatment of adult PTSD. TF-CBT is by far the most well-researched intervention and yields the highest efficacy. However, TF-CBT appears somewhat less acceptable than non-TF-PIs.
Introduction
Post-traumatic stress disorder (PTSD) is a common condition that often follows a chronic course if left untreated and puts a substantial burden on affected individuals and society at large1–3. Recent wars, pandemics and natural disasters illustrate the high prevalence of trauma exposure in the general population4–7. Since a substantial minority of individuals will develop PTSD in the aftermath of trauma exposure, its effective treatment remains a national and global health priority. Psychological interventions are recommended as the first-line treatment for PTSD in leading treatment guidelines8. Over the past four decades, a range of psychological interventions for PTSD in adulthood were developed and their efficacy and acceptability have been examined in numerous randomized controlled trials (RCTs). Several recent pairwise meta-analyses9–11 and network meta-analyses12–15 (NMAs) found evidence of large short-term and long-term efficacy of psychological interventions relative to passive control conditions, moderate short-term and long-term efficacy compared to active control conditions and adequate acceptability of psychological interventions with similar or slightly higher dropout rates relative to control conditions. Trauma focused cognitive behaviour therapy (TF-CBT) is the most well-researched psychological intervention for PTSD, followed by Eye Movement Desensitization and Reprocessing (EMDR). However, the evidence base for other psychological interventions with or without trauma focus (other-TF-PIs & non-TF-PIs) is expanding, and the debate on whether a trauma focus is necessary for high efficacy in PTSD treatment continues. Advocates of non-TF-PIs have postulated that these interventions may be equally effective and yet more acceptable than trauma-focused psychological interventions because patients do not need to get exposed to distressing traumatic memories16.
A comprehensive NMA may inform about the relative efficacy and acceptability of trauma-focused psychological interventions relative to non-trauma-focused psychological interventions. This method allows integrating data from direct and indirect treatment comparisons and provides estimates of the relative effect of any given pair of interventions within the network of included interventions. That is, NMAs include comparisons between pairs of interventions that have never been evaluated within an individual RCT. NMAs may yield more precise estimates than the direct estimates produced in pairwise meta-analyses17. While three NMAs have recently been published in the field of PTSD, the present NMA adds to these in four main regards. First and foremost, a comprehensive NMA is lacking. Two recently published NMAs focused on one specific psychological intervention rather than all psychological interventions 13,14 and the other NMA15 is based on a search performed in January 2018 with 90 included RCTs compared to 157 included RCTs in the present NMA. Second, no NMA has adequately investigated the impact of trial quality, which may bias quantitative summaries of clinical research18. While trial quality was assessed in all previous NMAs and qualitative judgments were reported in terms of the general risk of bias and the general level of confidence in study conclusions, the potential impact of risk of bias on treatment effects was not examined (e.g., analyses including only trials with a low risk of bias). Third, the only recent NMA on the efficacy of all psychological interventions15 did not examine the potential impact of varying treatment delivery formats on outcome estimates (e.g., group TF-CBT and individual TF-CBT were merged in their analyses). Fourth, a comprehensive NMA of long-term efficacy is lacking. Mavranezouli et al.15 included follow-up data up to 4 months post-treatment. However, various studies reported longer follow-up assessments such as twelve months19. To this end, we conducted a comprehensive NMA of RCTs on the short-term and long-term efficacy and acceptability of psychological interventions with and without trauma focus for adult PTSD while statistically controlling for trial quality and treatment delivery format.
Method
The aims and methods of the present NMA were pre-registered with the PROSPERO database (CRD42020206290). This NMA adheres to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines for NMAs20. See Appendix A (in the supplementary information) for the PRISMA checklist. The systematic literature search, data extractions, and quality ratings were carried out independently by at least two authors. We defined the main structured research question outlining the Population, Intervention, Comparison, Outcome, and Study design (PICOS) as follows: in adult individuals with diagnosed PTSD (P), how do psychological interventions with or without trauma focus (I), compared to control conditions (C), perform in terms of their efficacy and acceptability in reducing adult PTSD (O) in randomized controlled trials (S)?
Identification and selection of studies
For the timespan from inception to September 2020, we relied on our previous literature search10. For the timespan thereafter and up to April 21st 2022, we conducted a new systematic literature search by applying the same search strategy. THH and MJ carried out the systematic literature search. Discrepancies were discussed amongst THH, MJ and NM. We searched MEDLINE, PsycINFO, Web of Science and PTSDpubs with multi-field searches (titles, abstracts and key words) utilizing various Thesaurus and MeSH search terms for PTSD as well as treatment (see Appendix B for the search string). No restrictions on language or format of publication (e.g., dissertations or book chapters) were applied. We also inspected 176 related qualitative and quantitative reviews for further eligible trials. See Appendix C for their references. We further searched the US Veteran Affairs trial registry and the reference lists of included trials for further eligible trials.
Identification and selection of studies
In line with our previous study10, we included trials that met all of the following inclusion criteria: 1) random group allocation, 2) at least one arm investigating the efficacy of a psychological intervention was compared to either a control condition (passive or active) or to another psychological intervention from a different intervention family (see below), 3) mean age of sample ≥ 18 years, 4) at least ten participants analysed per comparison group, 5) PTSD was the primary complaint and primary treatment target, 6) at least 70% of the total participants were diagnosed with PTSD at baseline by means of a (semi-)structured interview based on PTSD criteria reported in any iteration of the Diagnostic and Statistical Manual of Mental Disorders (DSM21) or the International Statistical Classification of Diseases (ICD22). RCTs were excluded if they included only patients with PTSD and comorbid substance use disorders23 or comorbid traumatic brain injury24. Other than that, comorbidities were allowed as long as inclusion criterion 5) was met. Attentional trainings25 and attentional bias modification trainings26 were not deemed to belong to the category of psychological interventions and excluded. In cases where all inclusion criteria were met but the reporting was insufficient to calculate effect sizes, we contacted the corresponding author of the given publication via e-mail. In case of no response, we sent a reminder e-mail one month later in an attempt to obtain the relevant data. If we did not receive a response, the respective study was not included.
Quality assessment
Risk of bias was independently assessed by THH and AK by means of eight quality criteria reported by Cuijpers et al.18. These criteria were originally based on the Cochrane Collaboration criteria to assess the methodological validity of clinical research27 and criteria to assess the quality of evidence-based treatment delivery28. Criteria were scored dichotomously leading to a possible quality sum score ranging from 0 to 8. Trials met the respective quality criterion when: 1) 100% of the included participants were diagnosed with PTSD at baseline by means of a diagnostic interview, 2) a treatment manual was followed and sufficiently reported on, 3) therapists were trained to apply the particular manual, 4) the treatment integrity was formally checked (e.g., regular supervision or standardized quantitative ratings of recordings), 5) intention-to-treat (ITT) results were reported, 6) N ≥ 50 (i.e., n1 + n2 ≥ 50), 7) a valid randomization procedure was performed, and 8) PTSD outcomes were assessed by blinded assessors or by self-report measures. Multi-arm trials may receive different quality sum scores per comparison in the light of varying group sizes (see quality criterion 6). In case of insufficient or missing reporting, the respective trial was rated as not meeting the given quality criterion. Trials were categorized as high-quality (i.e., low risk of bias) when at least seven quality criteria were met18. Initial agreement on independent ratings was good (90.31%). Disagreements were discussed and solved amongst THH, AK and NM. See the quality assessment tool in Appendix D and the quality ratings per trial in Appendix E.
Categorization of interventions and control conditions
We divided psychological interventions into the following four categories: TF-CBT, EMDR, other-TF-PIs (e.g., imagery rehearsal therapy29) and non-TF-PIs (e.g., present centered therapy30). While several different interventions belonged to the other-TF-PIs and non-TF-PIs categories, there were too few trials to analyse these separately. With respect to TF-CBT, various interventions that share the core denominator of being based on CBT principles and involving a focus on the memory of the trauma(s) and/or trauma meaning have been applied in RCTs for PTSD. In the present NMA, the term TF-CBT is therefore an umbrella term for interventions such as cognitive therapy31, prolonged exposure32 or narrative exposure therapy33. Control conditions were divided into active control conditions (e.g., supportive counseling or treatment-as-usual) and passive control conditions (e.g., wait-list control or minimal attention). See Appendix F for categorizations of interventions and control conditions.
Categorization of assessment timepoints
The following three assessment timepoints were distinguished for the efficacy estimates: post-treatment (i.e., treatment endpoint), follow up 1 (FU1, ≤ five months after treatment termination) and follow-up 2 (FU2, > five months after treatment termination). In cases where several assessments fell into the FU1 category, the one closest to five months was chosen. In cases where several assessments fell into the FU2 category, the longest assessment was chosen. Since we were interested in the acceptability of psychological interventions rather than the acceptability of being part of a clinical trial (i.e., doing repeated assessments over time), we focused on all-cause dropout rates between randomization until treatment endpoint.
Data extraction
THH, MJ and AK independently extracted data. Disagreements were discussed between THH, MJ, AK, and NM. We extracted characteristics of the study (e.g., country of conduct, completer vs intention-to-treat analyses), participants (e.g., mean age, percentage females), interventions and control conditions (e.g., delivery format), and outcome data (sample size, mean & standard deviation per group at post-treatment, FU1 and FU2; all-cause dropout pre to post-treatment). When a trial included two psychological interventions from the same family, the primary intervention as indicated by the authors was chosen. For example, cognitive processing therapy rather than prolonged exposure therapy was chosen for Resick et al.34. When a trial included two variants of the same psychological intervention, we chose the bona fide variant. For example, in trials investigating the potential influence of session frequency on treatment efficacy, we included the psychological interventions delivered at ordinary frequency and excluded the extraordinary (i.e., intensely) delivered psychological interventions30,35. If available, we prioritized clinician-based PTSD outcome data such as the Clinician-Administered PTSD Scale (CAPS36) over self-report data. Similarly, intention-to-treat (ITT) data were prioritized over completer data.
Outcomes
Relative short and long-term efficacy were estimated with standardized mean differences (Hedges’ g) of PTSD symptom severity37. Acceptability was estimated via relative risk (RR) of all-cause dropout.
Statistical analysis
Data processing and statistical analyses were performed in R (version 3.6.1)38 utilizing the packages dplyr39, Rcpp40, readxl41, netmeta42, and metafor43. All analyses were based on a statistical significance level of α = .05. We calculated random effects NMAs because substantial heterogeneity was to be expected due to the high diversity in interventions and high diversity in populations studied. The netmeta package uses a frequentist weighted least squares approach. Hedges’ g (standardized mean differences, SMDs) were calculated by subtracting the group mean of the second group from the group mean of the first group, dividing the difference by the pooled standard deviation and then multiplying the quotient with the sample size correction factor J = 1 – (3/(4df − 1)37. Following Cohen’s conventions, SMDs may be interpreted as small (0.20), medium (0.50), and large (0.80)44. Effect sizes were reported with their 95% confidence intervals. To check whether the transitivity assumption was met, we compared whether comparison dyads differed on important patient characteristics (e.g., mean age of sample) and/or trial characteristics (e.g., trial quality). Furthermore, we checked for inconsistency in the global network20,42 and locally (i.e., per comparison) with net heat plots45 and the net splitting method46. We calculated τ2 and I2 to estimate heterogeneity in outcomes47. The latter indicates the proportion of the total variance in outcomes attributable to τ2 and may be interpreted as low (25%), moderate (50%), and high (75%)48. Furthermore, we calculated Qhet as a measure of heterogeneity within comparison designs and Qinc as measure of heterogeneity between comparison designs49. To check for potential small-study effects and publication bias, we performed Egger’s test of asymmetry50 and inspected funnel plots. We defined outliers as observations that were at least 3.3 standard deviations above or below the pooled SMDs51. When we detected a minimum of one outlier, we conducted outlier-adjusted analyses. We further performed two sensitivity analyses for the NMAs of efficacy: a) analyses including only trials with low risk of bias (i.e., high-quality trials, see above); b) analyses including only trials delivering psychological interventions individually and face-to-face (i.e., excluding trials with other delivery formats such as group therapy or technology-based delivery which mainly belonged to TF-CBT potentially violating the transitivity assumption). We also calculated the surface under the cumulative ranking (SUCRA) for the data on short and long-term efficacy per assessment timepoint for the main as well as the sensitivity analyses to rank interventions by efficacy.
Estimating the relative acceptability was impeded by the fact that various studies reported zero pre to post-treatment dropout for all groups, which may bias results in (network) meta-analyses52,53. Consequently, we chose to calculate relative risk with pairwise meta-analyses because the calculation of relative risk excludes all comparisons with absolute risks of zero for both groups. Pairwise meta-analyses were only conducted when the evidence base for a given comparison was sufficiently large (i.e., k ≥ 4)10. Random effects pairwise meta-analyses were conducted because we expected large heterogeneity in outcomes due to large variability in populations and interventions studied. Relative risk is calculated by dividing the absolute risk (i.e., proportion of all-cause dropout) in the first comparison group by the absolute risk in the second comparison group. A relative risk of 1 indicates an equal risk among the two groups, a relative risk of below 1 indicates a lower risk in the first comparison group compared to the second comparison group and vice versa. We calculated 95% confidence intervals of relative risk around the I2-statistics with the non-central chi-squared-based approach54. We also calculated the pooled proportions of all-cause dropout per group in percent to provide an estimate of the general incidence of all-cause dropout per group. To summarize proportions, we conducted random effects pairwise meta-analyses of Freeman-Tukey double arcsine transformed prevalence proportions with the inverse variance method55. Furthermore, Agresti–Coull 95% confidence intervals were calculated56. Heterogeneity in outcomes was estimated by Q-statistics and the I²-statistics. As recommended57, we performed the Egger’s test of asymmetry to detect potential publication bias only when the evidence base was sufficiently large (i.e., k ≥ 10). In case Egger’s test indicated significant asymmetry, we used the trim-and-fill method and reported asymmetry-adjusted results58. As in the NMAs, we conducted and reported outlier-adjusted pairwise meta-analyses when at least one outlier was identified (see definition above).
Results
Study selection and characteristics
The examination of titles and abstracts led to the exclusion of 5,526 references. Of 206 full-texts screened, 21 reported on eligible RCTs. As such, a total of 157 RCTs were included (including 136 RCTs from our previous search10) comprising 11,565, 4,830 and 3,338 adult patients at post-treatment assessment, ≤ five months follow-up and > five months follow-up, respectively. Figure 1 depicts the corresponding PRISMA flow chart of the study selection process and search synthesis.
PRISMA flow chart of study selection
The vast majority of published trials (87%) were conducted in Western countries. Across all 157 RCTs (i.e., unweighted mean), participants were on average 39.80 years old and 59% of them were females. Thirty-eight trials (24%) included only female participants, fifteen trials (10%) only male participants and the remaining 66% of trials both sexes. A little less than half of the trials (41%) included participants with diverse trauma history and the remaining trials included participants with a specific trauma history, the most prevalent specific trauma history being combat (21% of trials) and sexual assault (17% of trials). Nine trials (6%) included exclusively participants who experienced their index trauma during childhood. Seventy-five trials (48%) reported on concurrent intake of psychotropic medication (i.e., whether participants were allowed to remain on a stable regimen of psychotropics during the treatment phase or not and how many participants were medicated during trial). Only eight trials (11% of those reporting on psychotropics) administered psychological interventions strictly as monotherapy (i.e., prohibiting participants to take any psychotropic medication during treatment16,59–65). Across trials reporting on concurrent intake of psychotropics, about 48% of participants were taking at least one psychotropic during psychological treatment.
On average, total treatment length across psychological interventions was 921 minutes (SD = 757 minutes) with an average of 11 treatment sessions (SD = 5 sessions). Most trials (82%) reported on the frequency of therapy sessions. Of these, three in four trials (75%) administered psychological interventions on a weekly session basis and the other quarter administered the psychological interventions with higher frequency such as twice weekly66. Trial quality was moderate on average (mean = 5.81 out of 8, SD = 1.46). Most trials included only participants meeting PTSD diagnostic criterial at baseline (90%), utilized a treatment manual (85%), involved manual-trained study therapists (80%), checked treatment integrity (77%), utilized a valid randomization procedure (62%) and assessed outcomes blinded to treatment allocation (86%). About half of the included trials reported results based on intention-to-treat analyses (53%, rather than completer analyses), involved a well-powered sample size (N ≥ 50, 48%) and utilized the gold standard PTSD measure, the CAPS (53%) as (one of the) outcome measure(s). About three in four trials (78%) delivered psychological interventions in individual face-to-face format. Other delivery formats were group therapy67, couple therapy68, internet/technology-based interventions either completely or mainly delivered remotely69,70 or face-to-face technology-aided interventions such as 3MDR (i.e., a virtual reality-assisted version of EMDR71). Results of six trials were included in the analyses of follow-up data only. One of these trials reported data on fewer than ten participants in the control condition at the post-treatment assessment72 and the other five trials did not conduct post-treatment assessments61,73–76. See Appendices F and G for a comprehensive overview of trial characteristics per included trial and a list of their references, respectively.
Network graph and assumption checks
See Figure 2 for the network graph of the post-treatment assessment data and Appendices H and I for the network graphs for FU1 and FU2, respectively, and Appendix J for the number of trials per dyad for all NMAs including the sensitivity analyses. The vast majority of trials investigated the efficacy of TF-CBT. See Figure 3 for a bean plot on the distribution of participants’ mean age across comparison dyads and Appendix K for a bean plot on the distribution of the proportions of females in the total sample and Appendix L for a general comparison of participant and study characteristics across comparison dyads.
Network graph for the NMA on short-term efficacy
Nodes sizes are proportional to the number of included participants per dyad and the thickness of lines is proportional to the number of direct comparisons. ACC – active control conditions (e.g., treatment-as-usual), EMDR – eye movement desensitization and reprocessing, non-TF-PIs – non-trauma-focused psychological interventions, other-TF-PIs – other trauma-focused psychological interventions (i.e., other than TF-CBT and EMDR), PCC – passive control conditions (e.g., waitlist), TF-CBT – trauma-focused cognitive behaviour therapy
Bean plot of mean age across comparison dyads for the NMA on short-term efficacy
ACC – active control conditions (e.g., treatment-as-usual), EMDR – eye movement desensitization and reprocessing, non-TF-PIs – non-trauma-focused psychological interventions, other-TF-PIs – other trauma-focused psychological interventions (i.e., other than TF-CBT and EMDR), PCC – passive control conditions (e.g., waitlist), TF-CBT – trauma-focused cognitive behaviour therapy
Network meta-analysis on short-term efficacy
At post-treatment assessment, the random effects NMA yielded large effect sizes for all psychological interventions when compared to passive control conditions (i.e., SMDs ≥ 0.8, p < .001). Compared to active control conditions, TF-CBT and EMDR were moderately more effective in reducing PTSD (i.e., SMDs > 0.5, p < .001) and other-TF-PIs and non-TF-PIs were slightly more effective (i.e., SMDs between 0.2 and 0.5, p < .05). Psychological interventions did not differ significantly in their efficacy with two exceptions. TF-CBT was found more effective than other-TF-PIs (SMD = 0.30, p = .033) and non-TF-PIs (SMD = 0.17, p = .017). Heterogeneity and inconsistency were large and significant within but not between comparison groups (τ2 = 0.16, I2 = 69.10%; Qtotal = 533.22, df = 165, p < .001; Qhet = 499.04, df = 141, p < .001; Qinc = 34.14, df = 24, p = .082). See Table 1 for an overview of the results and Appendices M and N for forest plots of short-term efficacy with passive control conditions and non-TF-PIs as reference groups, respectively, as well as Appendix O for the funnel plot (including the result of the Egger’s test) of all comparisons that included a control condition and Appendix P for the netheat plot. The NMA yielded very similar results when outliers were removed and the heterogeneity remained high (see Appendix Q for an overview and Appendix R for a funnel plot).
Comparative short-term efficacy of psychological interventions (PIs)
Sensitivity analyses
At the post-treatment assessment, about one in three trials (38%, k = 57) were classified as high-quality with low risk of bias (i.e., meeting at least seven of the eight quality criteria) and about three in four trials (73%, k = 110) delivered the psychological intervention(s) individually face-to-face. In the sensitivity analyses in which we controlled for the potential impact of risk of bias and heterogeneity in treatment delivery formats, results remained by and large the same. See Table 1 for an overview of the results and Appendix Q for the outlier-adjusted results.
Network meta-analysis on long-term efficacy
Sixty-five and 37 trials included data collected at FU1 and FU2 assessments, respectively. Follow-up assessments were conducted on average 3.18 months (SD = 1.56 months) and 8.14 months (SD = 2.78 months) after the end of treatment, respectively. At FU1 (i.e., ≤ five months after the end of treatment), TF-CBT (SMD = 0.92, 95% CI: 0.71-1.13), EMDR (SMD = 0.84, 95% CI: 0.50-1.18) and other-TF-PIs (SMD = 0.80, 95% CI: 0.12-1.10) produced large effect sizes compared to passive control conditions and non-TF-PIs produced moderate effect sizes (SMD = 0.69, 95% CI: 0.44-0.93). Compared to active control conditions at FU1, TF-CBT produced moderate effect sizes (SMD = 0.56, 95% CI: 0.38-0.74) whereas EMDR (SMD = 0.48, 95% CI: 0.14-0.82) and non-TF-PIs (SMD = 0.33, 95% CI: 0.12-0.54) produced small effect sizes. Other-TF-PIs, however, were not found more effective than active control conditions (SMD = 0.44, 95% CI: −0.20-1.08). Generally, psychological interventions did not differ in terms of their efficacy at FU1 except TF-CBT being more effective than non-TF-PIs (SMD = 0.23, 95% CI: 0.06-0.40). Heterogeneity and inconsistency were moderate to large and highly significant within as well as between comparison groups (τ2 = 0.12, I2 = 64.00%; Qtotal = 177.74, df = 64, p < .001; Qhet = 146.93, df = 52, p < .001; Qinc = 30.66, df = 12, p = .002). See Table 2 for an overview of results and Appendices S and T for forest plots of relative efficacy at FU1 with passive control conditions and non-TF-PIs as reference groups, respectively, as well as Appendix U for the funnel plot excluding head-to-head comparisons. Egger’s test was significant (see Appendix U). After removing outliers, however, Egger’s test was not significant anymore (see Appendix V). The netheat plot can be found in Appendix W. Results remained robust when outliers were removed and heterogeneity decreased somewhat but remained significant (see Appendix X).
Comparative long-term efficacy of psychological interventions
At FU2 (i.e., > five months after the end of treatment), TF-CBT (SMD = 0.71, 95% CI: 0.43-0.98), other-TF-PIs (SMD = 0.62, 95% CI: 0.18-1.05) and non-TF-PIs (SMD = 0.51, 95% CI: 0.19-0.82) were moderately more effective than passive control conditions. However, SMDs for the latter two categories of psychological interventions were estimated via indirect comparisons only. EMDR was found slighlty more effective than passive control conditions, and with only one available direct comparison (SMD = 0.42, 95% CI: 0.01-0.89). Results for the comparison to active control conditions were similar to those for the comparison to passive control conditions, with TF-CBT robustly yielding the largest SMDs. There was no evidence of differences in efficacy between PIs. Yet, TF-CBT appeared somewhat more effective than non-TF-PIs (SMD = 0.20, 95% CI: 0.04-0.35). Noteworthy, trials examining the long-term efficacy of other-TF-PIs and EMDR were scarce and trials on non-TF-PIs were limited to the comparison with TF-CBT. Heterogeneity and inconsistency were moderate and statistically significant between, but not within, comparison groups (τ2 = 0.04, I2 = 45.00%; Qtotal = 61.84, df = 34, p = .002; Qhet = 49.31, df = 28, p = .008; Qinc = 12.51, df = 6, p = .052). See Table 2 for an overview of the results and Appendices Y and Z for forest plots of the relative efficacy at FU1 with passive control conditions and non-TF-PIs as reference groups, respectively, as well as Appendix AA and AB for the funnel plot and outlier-corrected funnel plot, respectively. The Egger’s test was non-significant in both the main analysis and the outlier-adjusted analysis (see Appendix AA & Appendix AB, respectively). See Appendix AC for the netheat plot. Results remained robust when outliers were removed and heterogeneity decreased somewhat but remained significant (see Appendix X).
Sensitivity analyses
At FU1, 39% of trials (k = 26) were classified as high-quality and 69% (k = 46) delivered the PI(s) individually face-to-face. At FU2, 53% of trials (k = 20) were classified as high-quality and 84% (k = 32) delivered the psychological intervention(s) individually face-to-face. Due to lacking trials and thus statistical power, the only feasible sensitivity analysis concerned the FU1 data for which it was possible to conduct a sensitivity analysis of trials that delivered psychological interventions individually face-to-face. Results remained were very similar to the main analysis (see Table 2) also when one outlier was removed (see Appendix X).
Ranking of efficacy
TF-CBT was robustly the best ranking psychological intervention category across timepoints in both main analyses and sensitivity analyses. EMDR was robustly the second-best ranking psychological intervention category apart from the FU2 for which other-TF-PIs were the second-best ranking psychological intervention category. Notably, trials assessing PTSD outcomes beyond five months after the end of treatment (i.e., FU2) remain generally scarce for all psychological intervention categories apart from TF-CBT and results are therefore to be regarded and interpreted with due caution (see Table 3 for all SUCRA results).
Efficacy rankingsa of psychotherapies and control conditions
Pairwise meta-analyses of acceptability
Most psychological interventions did not differ significantly from the control conditions in terms of their acceptability as measured by the relative risk (RR) of all-cause dropout from pre to post-treatment assessment. TF-CBT (RR=1.53; 95% CI: 1.23-1.90) and other-TF-PIs (RR=1.35; 95% CI: 1.00-1.83) were found somewhat less acceptable compared to passive control conditions. None of the psychological interventions differed from active control conditions in terms of acceptability. Data for other-TF-PIs in comparison to active control conditions were too scarce to allow for meta-analytic review. The only comparisons amongst psychological interventions with a sufficient number of trials were TF-CBT with EMDR and TF-CBT with non-TF-PIs. While no evidence was found for a differential acceptability of TF-CBT compared to EMDR, TF-CBT was found to be somewhat less acceptable than non-TF-PIs (RR=1.36; 95% CI: 1.08-1.70). Outlier-adjusted analyses as well as trim-and-fill-adjusted analyses yielded similar results. Across the various comparisons, dropout rates for psychological interventions ranged from about one in eight (12.17% for EMDR) to about one in four participants (26.34% for other-TF-PIs) and for control conditions from about one in 13 (7.90% for passive control conditions) to about one in five participants (20.56% for active control conditions). See Table 4 for an overview of all results.
Comparative acceptability of psychological interventions (PIs) and in comparison to control conditions
Discussion
The aim of this study was to comprehensively summarize the comparative short-term and long-term efficacy and acceptability of PIs for adult PTSD while controlling for trial quality and treatment delivery format. The up-to-date systematic literature search yielded 157 eligible trials. The vast majority of these investigated the efficacy and acceptability of TF-CBT. All psychological interventions were effective in the short-term and in the long-term when compared to control conditions, with TF-CBT consistently yielding the most favourable results. TF-CBT was also the only psychological intervention that distinguished itself from other psychological interventions. TF-CBT was more effective than non-TF-PIs in most analyses and across timepoints. The pairwise meta-analyses of the relative acceptability yielded similar or slightly higher dropout rates for psychological interventions compared to passive control conditions and similar dropout rates relative to active control conditions. The only difference in acceptability between PIs was found for TF-CBT compared to non-TF-PIs, with the former being somewhat less acceptable.
Comparison with previous research
Our results are in line with previous reviews. Most previous network and pairwise meta-analyses concluded that TF-CBT and EMDR are similarly effective in the treatment of adult PTSD9,15,77,78. However, one pairwise meta-analysis79 involving 11 trials concluded that EMDR outperforms TF-CBT. The data in our network meta-analysis, which are better suited to assess the relative efficacy of TF-CBT vs EMDR, indicate that these two treatments are similarly effective. As such, our findings support current treatment guidelines, most of which recommend these two interventions as first-line treatments8. Notably, the substantial gap in accumulated evidence particularly in terms of long-term outcomes precludes strong conclusions regarding the long-term efficacy of EMDR and some treatment guidelines do favor TF-CBT over EMDR in their recommendations80. More research is needed to draw firmer conclusions.
Furthermore, the present study is also in line with previous network and pairwise meta-analyses that did find higher efficacy of TF-CBT compared to non-TF-PIs in the short-run (i.e., at post-treatment assessment9,15,77). The relative long-term efficacy of TF-CBT and non-TF-PIs beyond four months follow-ups has not been analyzed yet in an NMA. A recent meta-analysis on the long-term efficacy of psychological interventions for adult PTSD concluded that TF-CBT and non-TF-PIs are similarly effective11. The present NMA is at odds with these findings by yielding superior long-term efficacy of TF-CBT over non-TF-PIs. Since our more recent search (i.e., performed in April 2022 vs. November 2019) resulted in a higher number of included trials, the present NMA had more power to find significant differences. Various trials on non-TF-PIs81 have been published after Weber et al’s11 search. Research on trauma-focused psychological interventions other than TF-CBT and EMDR remains scarce with very few studies evaluating long-term efficacy.
Psychological interventions for adult PTSD appear more effective than psychological interventions more generally, that is, across mental disorders. A recent umbrella review and meta-analysis82 summarized findings of 3,782 RCTs (N = 650,514 patients) on the efficacy of psychological interventions and pharmacotherapies for the treatment of various mental disorders and found a pooled SMD of 0.34 (95% CI: 0.26-0.42) for psychological interventions as monotherapy compared to placebo or treatment-as-usual, which is substantially below the SMDs found for psychological interventions in the present NMA (e.g., SMD of TF-CBT vs active control conditions at post-treatment assessment = 0.60). Similar results have been reported elsewhere. For instance, psychological interventions for PTSD produce larger treatment effects than psychological interventions for other anxiety-related disorders83.
Our results on acceptability are in line with a recent review of meta-analyses concluding that dropout rates tend to be higher in TF-CBT compared to other psychological interventions.84 Results are also mostly in line with a recent meta-analysis on the safety of psychological interventions summarizing 56 RCTs and concluding that psychological interventions were not associated with increased incidences of harms (i.e., deterioration, adverse events and serious adverse events) when compared to passive or active control conditions85. Rather, psychological interventions were safer than control conditions (both active and passive) in terms of deterioration risk. One difference to the present results was reported. While in the present work, we found TF-CBT to be somewhat less acceptable than non-TF-PIs, TF-CBT was found as safe as non-TF-PIs in terms of deterioration and adverse events and safer than non-TF-PIs in terms of severe adverse events in the other meta-analysis. This suggests that more patients prematurely drop out from TF-CBT than non-TF-PIs, yet patients receiving TF-CBT treatment do not appear to be at an increased risk of experiencing harms and a decreased risk of severe adverse events.
Strengths and limitations
Our study represents the first NMA of adult PTSD that comprehensively reports on both short-term and long-term efficacy of psychological interventions while statistically controlling for the potential influence of trial quality and varying delivery formats on outcomes. Inclusion criteria were strict to ensure validity of analyses. Trials with high risk of chance findings (i.e., N < 20) were excluded. We further increased internal validity by only including trials with largely clinical samples (i.e., ≥ 70% PTSD rate) and adherence to gold standard diagnostic procedures (i.e., diagnostic interview to assess eligibility of participants). Despite the strict inclusion criteria, a substantial evidence base of 157 RCTs was included. Yet, the present NMA has certain limitations. The main limitation concerns the heterogeneity in some of our psychological interventions categories as well as the active control conditions category. Other-TF-PIs and non-TF-PIs are a conglomerate of different psychological interventions with the common denominator that they do not belong to TF-CBT or EMDR. Our decision to merge interventions in these rather heterogenous categories was based on the availability of trials. As more trials accumulate, more fine-grained approaches of categorizations with sufficient power will become feasible. The content of active control conditions is very context dependent and heterogenous86. Future research may bring forward more sophisticated ways of subcategorizing active control conditions into more homogenous subcategories. Another limitation concerns the operationalization of treatment acceptability. A comparison of all-cause dropout rates across trial arms is just a proxy of acceptability and other ways of operationalizing and comparing acceptability should be brought forward. However, this operationalization has been used widely in NMAs14, including NMAs of other mental disorders such as major depression87,88. The present study did not investigate other important clinical outcomes such as response and remission rates or the tolerability of interventions. While being important, these were not our focus. Lastly, our definition of high-quality trials (i.e., trials with low risk of bias) can be criticized. Other authors have used a cut-off score of eight (out of eight) fulfilled quality criteria18 and we have used at least seven. This choice was based on an attempt to balance out strict criteria for the definition of high-quality trials and power consideration for the sensitivity analyses. A threshold of at least seven (out of eight) has been used before for similar reasons.89 As more high-quality trials accumulate, more conservative sensitivity analyses (with sufficient power) will become feasible.
Implication for clinical practice
The present results are reassuring for clinicians and patients because they illustrate that effective and acceptable psychological interventions for the treatment of adult PTSD exist. Most evidence and certainty exist for the short-term and long-term efficacy of TF-CBT in the treatment of adult PTSD. TF-CBT furthermore appears acceptable with only slightly higher all-cause discontinuation rates compared to passive control conditions and non-TF-PIs and no differences compared to active control conditions or EMDR. Other psychological interventions with and without trauma focus also appear to be effective and acceptable though these results are to be regarded with due caution in the light of considerably less available evidence. Though somewhat less acceptable, TF-CBT was found significantly more effective than non-TF-PIs immediately after treatment as well as across follow-ups. Some treatment guidelines do recommend treatment of adult PTSD with non-TF-PIs90. The evidence shows that non-TF-PIs do appear to be an effective (though somewhat less effective) alternative treatment, which, however, should rather be considered when treatment with TF-CBT or EMDR is not feasible, not effective or not in line with patient preferences.
Implications for future research
The present NMA is a significant first step in examining the differential short-term and long-term efficacy and acceptability of psychological interventions with or without trauma focus for adult PTSD. However, once enough research has accumulated to warrant sufficient statistical power, future meta-analytic research needs to further differentiate interventions within the non-TF-PIs and other-TF-PIs categories. Furthermore, the evidence base of trials assessing long-term efficacy remains scarce for all psychological interventions except TF-CBT. To allow for firmer conclusions regarding the relative long-term efficacy, more trials with long-term assessments of efficacy are needed. Additionally, future research needs to investigate potential moderating effects of other delivery formats than individual face-to-face delivery on outcomes. Once more trials accumulate, sensitivity analyses of trials delivering psychological interventions in group format or technology-based will become feasible.
Conclusions
The current evidence base suggests that bona fide psychological interventions are effective and acceptable in the treatment of PTSD relative to control conditions. However, TF-CBT is both the most well researched psychological intervention to date as well as the psychological intervention with most favourable results in terms of its short-term and long-term efficacy. TF-CBT was the only psychological intervention that distinguished itself from other psychological interventions with higher efficacy compared to non-TF-PIs. Results remained robust across outlier-adjusted analysis and sensitivity analyses. Psychological interventions were also generally acceptable with similar or only slightly increased risk of dropout compared to control conditions. Psychological interventions generally did not differ in their acceptability except for TF-CBT being somewhat less acceptable compared to non-TF-PIs. More research on psychological interventions other than TF-CBT is needed particularly evaluating long-term treatment efficacy to draw firmer conclusions in terms of overall and relative efficacy and acceptability.
Data Availability
All data analysed are publically accessible. No new data were created. The datasets and the R scripts are available on request via e-mail to the first/corresponding author (THH).
Data availability
All data analysed were extracted from published journal articles. No new data were created. The datasets and the R scripts are available on request via e-mail to the first author.
Funding
This research received no specific grant from any funding agency, commercial or not-for-profit sectors.
Author contributions
THH and NM conceptualized the present study. THH and MJ independently performed the literature search and data extractions. THH, HH, MJ and JM performed (parts of) the statistical analyses. THH wrote the first draft of the manuscript. All authors contributed to and have approved the final manuscript.
Conflict of interest
JM receives studentship funding from the Biotechnology and Biological Sciences Research Council (BBSRC, ref: 2050702) and Eli Lilly and Company Limited.
Footnotes
We performed another systematic literature search on April 21st 2022 to now include 157 RCTs (7 trials from the new search). The search strategy remained the same. However, we searched somewhat boader. That is, we now also searched PTBSpubs, the US Veteran Affairs trial registry as well as reference lists of included trials (on top of PsycINFO, MEDLINE & Web of Science). We updated our analyses accordingly and results remained robust.
References
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.
- 6.
- 7.↵
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.↵
- 13.↵
- 14.↵
- 15.↵
- 16.↵
- 17.↵
- 18.↵
- 19.↵
- 20.↵
- 21.↵
- 22.↵
- 23.↵
- 24.↵
- 25.↵
- 26.↵
- 27.↵
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.↵
- 38.↵
- 39.↵
- 40.↵
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.↵
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.↵
- 53.↵
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.↵
- 59.↵
- 60.
- 61.↵
- 62.
- 63.
- 64.
- 65.↵
- 66.↵
- 67.↵
- 68.↵
- 69.↵
- 70.↵
- 71.↵
- 72.↵
- 73.↵
- 74.
- 75.
- 76.↵
- 77.↵
- 78.↵
- 79.↵
- 80.↵
- 81.↵
- 82.↵
- 83.↵
- 84.↵
- 85.↵
- 86.↵
- 87.↵
- 88.↵
- 89.↵
- 90.↵