Temporal stability and state-dependence of retrospective self-reports of childhood maltreatment in major depression: a two-year longitudinal analysis of the childhood trauma questionnaire

Introduction

Childhood maltreatment (CM) has been implicated as a major risk factor for incidence and trajectory of depression and other psychiatric disorders (Lippard & Nemeroff, 2020). As such, maltreatment is often referred to as one of the key variables necessary to utilize for personalized medicine in psychiatry (Prendes-Alvarez & Nemeroff, 2016). To that end, a valid and practically feasible assessment of CM is crucial. However, the validity of currently established assessment methods has frequently been questioned (Hardt, Sidor, Bracko, & Egle, 2006).

Due to its extensive relevance, the consequences of CM have been subject of a plethora of research. However, the majority of empirical evidence relies on observational designs that implicate inherent limitations concerning their causal conclusiveness. Increased risk for the development of psychiatric disorders is among the most cited effects of CM, while most studies supporting this evidence rely on retrospective self-report measures (Green et al., 2010; Putnam, Harris, & Putnam, 2013) due to their high practicability (Hovdestad, Campeau, Potter, & Tonmyr, 2015). Cross-sectional studies cannot preclude that effects are at least partly inflated by psychopathological mechanisms affecting the recall and/or report of CM. This could particularly be true for Major Depressive Disorders (MDD). A negativity bias in regard to the appraisal of oneself, one’s future, and one’s environment is a core feature in MDD and central to influential cognitive models of depression (Beck, Rush, Shaw, & Emery, 1987). Correspondingly, negative biases have been described in different aspects of memory processes such as retrospective recall of mood state and autobiographical memories in depressed participants (Sato & Kawahara, 2011) and in healthy participants with experimentally induced low mood (Au Yeung, Dalgleish, Golden, & Schartau, 2006). It has been suggested that retrospective reports of CM could be biased in a similar way by depressive symptoms (Hardt & Rutter, 2004).

The suspected bias of CM reports due to depressive symptoms and the common use of retrospective self-reports in research make it crucial to re-evaluate our knowledge in this field. However, systematic assessments of the susceptibility of retrospective CM measures to depressive states are sparse. Fergusson and colleagues investigated temporal stability of retrospective interview regarding abuse at the ages of 18 and 21 in a population sample. They found that CM categorization was fairly unstable over the three-year interval but this variance was not systematically associated with changes in psychiatric status (Fergusson, Horwood, & Woodward, 2000). A major limitation of this study is, that it is unclear how many participants with clinically relevant symptoms of depression were included. Further it is questionable if findings generalize to CM assessments using well-established self-report instruments, and to other age groups. The latter is relevant because retrospective measures of CM are not only used in adolescents and young adults but throughout a wide age range up to participants over 60 years of age (Green et al., 2010).

One of the most widely used retrospective self-report questionnaires assessing CM is the Childhood Trauma Questionnaire (CTQ) (Bernstein et al., 1994), which has been utilized in hundreds of studies investigating CM (Viola et al., 2015). The psychometric qualities of the CTQ have been demonstrated in various patient samples (e.g. Hernandez et al., 2013; Spinhoven et al., 2014). and occasional evidence of high test-retest reliability exists (Cammack et al., 2017). However, although the latent construct measured by the CTQ naturally should be stable over time, the test-retest reliability seems to decreases with increasing duration of test-retest intervals (Bernstein et al., 1994; Cammack et al., 2017). Thus, it appears evident that significant variation in self-reports of CM over time is present. However, it is unknown to what extent this temporal variation can be explained by current depressive symptoms.

Validating any measure of CM is difficult due to a lack of a flawless measure it could be validated with. Prospective and often more objective measures (e.g. child protective services or hospital- or court records) have shown little overlap with retrospective self-report data (Baldwin, Reuben, Newbury, & Danese, 2019). However, that may be due to a limited sensitivity of prospective measures particularly regarding emotional maltreatment that is difficult to objectify or is not officially reported for other reasons (Hardt & Rutter, 2004).

CM has frequently been discussed as a key variable for the utilization in personalized medicine as lower treatment outcomes in maltreated individuals call for customized interventions for this patient group (Prendes-Alvarez & Nemeroff, 2016). However, in the context of personalized medicine, retrospective reports of CM are arguably without an alternative method of assessment as prospective measures are of virtually no use for the practical application of tailored treatments. It would thus be highly relevant for clinicians and researchers to know if and to what extent retrospective assessment of CM could be biased by concurrent depressive symptoms.

Hence, our main goal is to assess the extent of a depressive bias on retrospective self-reports of CM using the CTQ, and the validation of an approach adjusting CTQ scores for depressive symptoms. Therefore, existing data derived from a longitudinal design is used to investigate associations of changes in retrospective CM reports with changes in depression severity.

First, we aim to assess the test-retest reliability of retrospective self-reports of CM over a two-year interval. Further, we test the hypotheses that: 1) CM self-reports are biased by acute depressive symptoms and that 2) its reliability can be improved by adjusting CM reports for depressive symptom severity.

In addition, we investigate to what extent the susceptibility of longitudinal CTQ assessments to depressive symptom changes is differentially influenced across different maltreatment subtypes, depending on the age at assessment, across absolute levels of depression severity, or by the categorization of CM experiences (maltreated vs. non-maltreated).

Methods

Results

Temporal stability of maltreatment reports

Descriptively, individual reports of CM varied on average 3.77 (SD 3.91) and 4.02 (SD 4.19) CTQ sum points between T₁ and T₂ in the two cohorts (absolute change). Changes in scores during the interval ranged up to 22 CTQ points. Variability metrics are presented in Table S1.

Analysis of the CTQ sum scores yielded an excellent two-year test-retest reliability with ICC=.956 for the overall MACS sample. Subgroup analyses yielded highly similar reliability estimates for HC, MDD_C, and MDD_IC samples (Table 1, Fig 1A and 1C). The five subscales of the CTQ also showed high reliabilities overall. While its reliability was still high (ICC=.836), the physical neglect subscale had a significantly lower reliability compared to other subscales (Table S2).

View this table:

• View inline
• View popup
• Download powerpoint

Table 1.

Test-retest reliability estimates of continuous and categorical childhood maltreatment across MACS and MNC subsamples.

• Download figure
• Open in new tab

Fig 1.

Association of CTQ sum scores at T₁ and T₂ (panel A and C) and relationship between CTQ and BDI changes over a 2-year interval among MDD patients (panel B and D) across MACS and MNC samples.

Conducting test-retest analysis with categorical classification of CM yielded moderate agreement between T₁ and T₂ (K=.551). Again, reliabilities did not differ between HC, MDD_C, and MDD_IC. Analyses yielded highly consistent reliability estimates across cohorts and variables (i.e. continuous, categorical, and CTQ subscale analyses; Table 1 and Table S2).

Maltreatment reports of healthy controls with initial depressive episode in interval

A sample of diagnosis converters was investigated in an additional exploratory analysis. These converters were defined as participants with no history of psychiatric condition at T₁ but who fulfilled the criteria for an MDD diagnosis during the interval to T₂. Within MACS and MNC combined, a total of n=27 of such converters was available that were jointly analyzed. The analysis yielded a high temporal stability of CTQ sum scores (ICC=.933, 95%-CI[.853, .969], p<.001) with overlapping confidence intervals as for HC participants from both cohorts that did not experience depression symptoms during the interval (Fig 2). Similarly, ΔCTQ was not associated with ΔBDI (b=0.021, p=.933) in this sample in the regression model.

• Download figure
• Open in new tab

Fig 2.

Panel displays A) association of CTQ sum scores at T₁ and T₂, and B) association of changes in the CTQ with changes in the BDI in the converter sample.

Discussion

The primary findings of this investigation are that adult retrospective reports of CM using the CTQ are highly temporally stable over a two-year interval and that they are only marginally susceptible to selective negative bias in depressed patients. Temporal stability of continuous maltreatment load was superior to categorical classification of maltreatment.

Retrospective self-reports of CM have been frequently questioned due to potential memory or reporting biases particularly due to depressive symptomatology (Hardt & Rutter, 2004). Reports of low overlap between retrospective and prospective maltreatment measures have further nourished the notion of unclear validity of retrospective assessment instruments (Baldwin et al., 2019). Thus, we aimed to estimate the extent to which such biases occur in a longitudinal design. We found that temporal stability of retrospective maltreatment reports is largely identical between healthy controls and patients with depression. Furthermore, test-retest reliability of CTQ scores was equally high in MDD patients with shifting remission states (from acute to remitted or vice versa) as compared to congruent remission states at both assessment time points. These findings suggest that the temporal stability of retrospective maltreatment reports is not lower per se in people with a lifetime depressive disorder or with acute depressive symptomatology. This notion is largely consistent with a previous study that found equally stable maltreatment reports between clinical and non-clinical samples, using a non-validated interview (Fergusson et al., 2000). Although not directly probing maltreatment experiences, an early study investigating parental bonding recall, similarly found that individuals’ reporting behavior was highly comparable whether depression symptoms were acute or remitted (Parker, 1981).

Investigating intra-individual changes in depressive symptoms we did observe that longitudinal shifts towards higher depression severity were associated with higher levels of reported maltreatment experiences in our larger sample (n=271). However, this effect was small, with changes in depressive symptoms accounting for only 2% of variance in shifts of maltreatment reports. Also, this association failed to reach significance in an independent smaller sample, presumably due to lower statistical power given the small effect size.

Despite little evidence for a depressive recall bias in the above analysis, one could still argue that participants suffering from a depression at both time points reliably show stably altered reporting of maltreatment experiences, without causing increased variability in reports. The notion of a lifetime depression causing a temporally stable bias is consistent with findings of cognitive biases, as overgeneralization of one’s own past, persisting even after remission (Mackinger, Pachinger, Leibetseder, & Fartacek, 2000). A particular strength of the current study is the inclusion of a sample with participants that had an initial depressive episode between both measurement time points (n=27). Data from this sample suggest that adults that have never experienced clinically relevant depressive symptoms do not start reporting on their childhood experiences differently once experiencing an initial depressive episode. While this finding further strengthens the validity of the CTQ measure, low statistical power for this particular sample limits conclusions about a potential small-scale effect of depressive symptoms on maltreatment reports in adults with an initial depressive episode. Mixed findings regarding a depressive bias on retrospective maltreatment reports have been reported by previous studies. Evidence from a large epidemiological study indicates that 12-year test-retest incongruence in reports of adverse experiences can be predicted by depression, and psychological distress (Colman et al., 2016). However, a non-validated interview about a wide variety of experiences (e.g. hospital stay, parental unemployment, physical abuse) was used in this study making it difficult to generalize results to other maltreatment measures. In another epidemiological study also using a non-validated interview, the authors concluded that in a three-year interval a compound mental health index (implicating various symptom domains) accounted for a minor amount of the variability of sexual abuse reports but not for variability in physical abuse assessments (Fergusson, Horwood, & Boden, 2011). No evidence for a recall bias in any abuse or neglect subscales was found by Pinto and colleagues who investigated stability of maltreatment reports via a questionnaire similar to the CTQ in a six-month interval in institutionalized young adults (Pinto, Correia, & Maia, 2014). Differences in assessments methods, as well as sample characteristics of these studies make a comparison difficult. However, taken together with our findings the evidence suggests that a reporting bias due to depressive symptomatology is not present or negligible due to very small effect sizes. This seems to be the case particular for retrospective maltreatment reports assessed via a well-validated measure as the CTQ. While the stability of the total score of the CTQ was largely independent of depressive symptom change, our findings suggest that reports of emotional types of maltreatment may tend to be more susceptible to depressive symptoms as compared to other subtypes of abuse and neglect. Thus, clinicians and researchers utilizing emotional subscales of the CTQ as isolated measures are advised to interpret the reports with caution regarding a potential bias.

We originally aimed to test an adjustment procedure that corrects CTQ scores for current depressive symptom severity in order to improve the validity of the retrospective maltreatment reports. However, this approach did not yield a psychometric improvement which seems reasonable considering that findings suggest low susceptibility of CTQ scores for depressive symptoms, and the temporal stability was already excellent prior to any correction procedure. Baseline depression severity and age were also not predictive for variability in CTQ scores.

Overall, we found CTQ scores to be highly temporally stable across a two-year interval. Previous studies investigating the temporal stability of various retrospective maltreatment measures other than the CTQ mostly reported much lower test-retest estimates particularly when a categorization of maltreatment experiences was implemented. Congruence no better than chance between interview reports of autobiographical childhood memories (including physical and emotional punishment) was reported by Offer et al. (2000). Moderate congruence of retrospective reports on sexual and physical abuse were presented in a community sample (Fergusson et al., 2000), and a mixed psychiatric sample (Hardt et al., 2006). In contrast test-retest agreement of continuous abuse and neglect scores based on questionnaire data of institutionalized adolescents and young adults was found to be more comparable to our results although somewhat lower (Pinto et al., 2014). When only regarding research investigating the CTQ, the reported temporal stability of continuous (Bernstein et al., 1994; Shannon et al., 2016) and categorical (Cammack et al., 2017; Shannon et al., 2016) data is highly similar to our estimates. Notably, evidence consistently indicates that temporal stability of continuous CTQ scores tends to be higher as compared to the stability of categorical classifications. Superiority of continuous over categorical assessments is well-documented concerning various psychopathological measures (Markon, Chmielewski, & Miller, 2011).

We further replicated previous findings that CM experiences are associated with more severe depressive symptoms (Lippard & Nemeroff, 2020). Baseline CTQ scores associated with concurrent depression severity and predictive for symptomatology two years later. Considering that we found little evidence for a depressive bias on the reports of CM this supports the notion of CM experiences negatively affecting psychopathology later in life.

There are several important limitations. The generalization to other measures of retrospective self-reports of maltreatment is unclear. Further, our study design is not sensitive for potential long-term effects of chronic depressive symptoms over the course of more than two years on the reporting of CM. Notably, while on average CTQ scores were temporally stable, some individuals showed very high fluctuation in maltreatment reports. A potential reporting bias may be moderated by other factors that were not regarded in the current study as specific comorbidities or personality profiles. Further, so-called ‘biases’ e.g. due to depression may be brought about by increased administration of psychotherapy that may cause a more accurate reflection on one’s own childhood and thereby change appraisal and reports of maltreatment.

Conclusion

In summary, findings from the presented preregistered analyses suggest that the CTQ is a temporally stable tool for the retrospective assessment of CM that is not susceptible for changes in depressive symptoms. The evidence against depression bias in combination with high practicability encourages the utilization of validated retrospective self-report tools for the assessment of CM for researchers and clinicians. Further, findings promote a continuous rather than categorical conceptualization of maltreatment experiences. Such gradual approach seems to improve psychometric qualities and may also more accurately represent the complex neurobiological basis, as well as clinical consequences of abuse and neglect. Personalized medicine approaches modelling disease trajectories based on retrospectively collected risk variables are therefore highly advised to conceptualize a gradual maltreatment load in order to increase its predictive potential.

Key points and relevance

Data access and responsibility

All PIs take responsibility for the integrity of the respective study data and their components. All authors and co-authors had full access to all study data.

Data availability

The data that support the findings of this study are openly available in the Open Science Framework at https://osf.io/9754h/, DOI: 10.17605/OSF.IO/9754H.