Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Excess Burden of Depression among HIV-Infected Persons Receiving Medical Care in the United States: Data from the Medical Monitoring Project and the Behavioral Risk Factor Surveillance System

  • Ann N. Do ,

    aad9@cdc.gov

    Affiliation Division of HIV/AIDS Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Eli S. Rosenberg,

    Affiliation Emory University Rollins School of Public Health, Atlanta, Georgia, United States of America

  • Patrick S. Sullivan,

    Affiliation Emory University Rollins School of Public Health, Atlanta, Georgia, United States of America

  • Linda Beer,

    Affiliation Division of HIV/AIDS Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Tara W. Strine,

    Affiliation Office of Public Health Preparedness and Response, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Jeffrey D. Schulden,

    Affiliation National Institute on Drug Abuse, Rockville, Maryland, United States of America

  • Jennifer L. Fagan,

    Affiliation Division of HIV/AIDS Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Mark S. Freedman,

    Affiliation Division of HIV/AIDS Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Jacek Skarbinski

    Affiliation Division of HIV/AIDS Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

Abstract

Background

With increased life expectancy for HIV-infected persons, there is concern regarding comorbid depression because of its common occurrence and association with behaviors that may facilitate HIV transmission. Our objectives were to estimate the prevalence of current depression among HIV-infected persons receiving care and assess the burden of major depression, relative to that in the general population.

Methods and Findings

We used data from the Medical Monitoring Project (MMP) and the Behavioral Risk Factors Surveillance System (BRFSS). The eight-item Patient Health Questionnaire was used to identify depression. To assess the burden of major depression among HIV-infected persons receiving care, we compared the prevalence of current major depression between the MMP and BRFSS populations using stratified analyses that simultaneously controlled for gender and, in turn, each of the potentially confounding demographic factors of age, race/ethnicity, education, and income. Each unadjusted comparison was summarized as a prevalence ratio (PR), and each of the adjusted comparisons was summarized as a standardized prevalence ratio (SPR). Among HIV-infected persons receiving care, the prevalence of a current episode of major depression and other depression, respectively, was 12.4% (95% CI: 11.2, 13.7) and 13.2% (95% CI: 12.0%, 14.4%). Overall, the PR comparing the prevalence of current major depression between HIV-infected persons receiving care and the general population was 3.1. When controlling for gender and each of the factors age, race/ethnicity, and education, the SPR (3.3, 3.0, and 2.9, respectively) was similar to the PR. However, when controlling for gender and annual household income, the SPR decreased to 1.5.

Conclusions

Depression remains a common comorbidity among HIV-infected persons. The overall excess burden among HIV-infected persons receiving care is about three-times that among the general population and is associated with differences in annual household income between the two populations. Relevant efforts are needed to reduce this burden.

Introduction

With the advent of effective treatment and resultant increases in life expectancy, HIV infection has become a chronic condition. As with other chronic medical conditions, HIV infection is often complicated by comorbid depression [1], [2], and there are serious concerns regarding the adverse impacts of depression on the quality of life and the course of illness among those living with HIV. Depressed persons with HIV frequently become non-adherent with their treatment [3][5], which may lead to higher HIV viral loads, higher infectiousness, and poorer clinical outcomes. Some studies have suggested a more rapid progression to AIDS or an increase in mortality associated with depression among persons with HIV [6][11]. In addition, depression is associated with substance abuse [2], [12], which may contribute to reduced quality of life and increased participation in high-risk behaviors that may transmit HIV.

As the number of persons living with HIV increases, it becomes increasingly important to understand the extent of the burden of depression among these individuals, so that appropriate measures can be taken to alleviate this burden and maximize the effectiveness of HIV treatment and prevention. Although previous studies have reported estimates of depression among either HIV-infected persons or the general population, few have concurrently examined depression among both, using the same measure of depression. Findings from previous studies that have compared the prevalence of depression between HIV-infected and uninfected individuals have been mixed, but many of these studies were limited to groups with specific characteristics (e.g., men who have sex with men, injection drug users) and involved small convenience samples [13][22]. A meta-analysis combining data from 10 such studies found that the prevalence of depression was higher among HIV-infected persons, compared to uninfected persons [23]. However, no previous study – to our knowledge – has compared depression prevalence using large population-based samples of HIV-infected persons and the general population.

In this report, we address the question of whether HIV infection is associated with major depression by using population-based data to estimate the prevalence of current depression among persons infected with HIV and comparing it to the prevalence of depression among persons in the general population. We also assess the roles of major demographic factors in any excess burden of depression experienced by those with HIV infection.

Methods

We describe the prevalence of depression in a nationally representative sample of HIV-infected persons receiving care using population-based data from the Medical Monitoring Project (MMP) and compare it to the prevalence of depression in a state-based probability sample of persons in the general population from the Behavioral Risk Factor Surveillance System (BRFSS).

Medical Monitoring Project (MMP)

MMP is a supplemental HIV surveillance system designed to produce nationally representative estimates of behavioral and clinical characteristics of HIV-infected adults receiving medical care in the United States. MMP methods, including weighting procedures, have been described in detail elsewhere [24][26]. Briefly, MMP uses a three-stage, probability-proportional-to-size sampling method. U.S. states and territories were sampled, then eligible facilities, and finally, eligible individuals. Eligible facilities were those that provide outpatient HIV care, defined as the treatment and management of HIV disease, including monitoring CD4 and HIV viral load tests, or the prescription of antiretroviral medications. For the 2009 data collection cycle, eligible persons were HIV-infected adults age 18 years or older receiving medical care in participating facilities between January and April 2009. Data were collected through face-to-face interviews and medical record abstractions from June 2009 through May 2010. All sampled project areas participated in MMP. Participating areas included 16 states (California, Delaware, Florida, Georgia, Illinois, Indiana, Michigan, Mississippi, New Jersey, New York, North Carolina, Oregon, Pennsylvania, Texas, Virginia, and Washington), 6 separately-funded large metropolitan areas (Chicago, Houston, Los Angeles County, New York City, Philadelphia, and San Francisco) within 5 of the sampled states, and Puerto Rico. Data from MMP were weighted to produce estimates that represent all HIV-infected adults receiving care in the U.S.

Ethics Statement

In accordance with the federal human subjects protection regulations at 45 Code of Federal Regulations 46.101c and 46.102d and with the Guidelines for Defining Public Health Research and Public Health Non-Research [27], [28], MMP was determined by the National Center for HIV, Viral Hepatitis, STD and TB Prevention’s Office of the Associate Director for Science at the Centers for Disease Control and Prevention (CDC) to be a non-research, public health surveillance activity used for disease control program or policy purposes. As such, MMP is not subject to human subjects regulations, including federal investigational review board (IRB) review. Nevertheless, participating project areas and facilities obtained local IRB approval to conduct MMP as required locally, and individual signed informed consents for participation in MMP were obtained as required locally. In addition, none of the authors of this manuscript has had access to any information that would directly identify individual persons on whom data were collected.

Behavioral Risk Factor Surveillance System (BRFSS)

The BRFSS is a state-based surveillance system operated by state health departments in collaboration with the CDC. The objective of the BRFSS is to collect uniform, state-specific data on preventive health practices and risk behaviors that are linked to chronic diseases, injuries, and preventable infectious diseases in the adult population [29], [30]. Using a standardized questionnaire, trained interviewers conduct telephone interviews with individuals in a probability sample of households with telephones in the non-institutionalized U.S. adult population. Detailed BRFSS survey methodology, including weighting procedures, is described elsewhere [31].

In brief, the BRFSS questionnaire consists of three parts: core questions that are asked in all 50 states, the District of Columbia (D.C.), Puerto Rico, and the U.S. Virgin Islands; local questions that are added by the states; and optional supplemental modules, which are a series of questions on specific topics (for example, adult asthma history, intimate partner violence, and mental health)[32]. In 2006 and 2008, the state health departments, in collaboration with CDC and the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, collaborated on the implementation of the Anxiety and Depression Module, which consisted of questions about depression severity and lifetime diagnosis of anxiety and depression (Anxiety and Depression Module) [32]. During 2006 and 2008 combined, a total of 45 states, D.C., Puerto Rico, and the U.S. Virgin Islands implemented this module (29 states, D.C., Puerto Rico, and U.S. Virgin Islands in 2006; 16 states in 2008). For the 9 states that implemented the module during both 2006 and 2008 (Hawaii, Kansas, Louisiana, Maine, Mississippi, Nebraska, North Dakota, Vermont, and Washington), only the 2008 data were included in this analysis.

Eight-item patient health questionnaire depression scale (PHQ-8)

The PHQ-8 consists of eight of the nine criteria on which the Diagnostic and Statistical Manual of Mental Disorders, 4th Edition (DSM-IV) diagnosis of depressive disorders is based [33]. The ninth question in the DSM-IV assesses suicidal or self-injurious ideation and was omitted because not all interviewers were trained mental health providers. Research indicates that the deletion of this question has only a minor effect on scoring because active thoughts of self-harm are uncommon in the general population [34] and in primary care settings [35], [36]. The PHQ-8 has been shown to be comparable to the PHQ-9 [37], [38], which includes all nine DSM-IV criteria for depressive disorders and has demonstrated good psychometric properties in detecting major depression in non-psychiatric care settings. In a published review of validation studies, the PHQ-9 had reported values for sensitivity of 0.77 to 0.88, specificity of 0.88 to 0.94, internal reliability (Cronbach α) of 0.86 to 0.89, and external reliability (test-retest) of 0.84 in detecting major depressive disorders in a variety of care settings and patient populations [37]. Both the PHQ-8 and PHQ-9 have been used in clinical [39][44] and general population settings [45][48], and both have been used in self-administered [42][44], [48] and telephone-administered modes [45], [49]. The PHQ-9 has also been shown to be effective for detecting depressive symptoms in various racial and ethnic groups [44], [46], [49], [50].

For both MMP and BRFSS, participants were considered to have current major depression if, for “more than half the days” in the preceding two weeks, they met at least five of the eight criteria, including at least one of the following: 1) "little interest or pleasure in doing things" or 2) "feeling down, depressed, or hopeless." Participants were considered to have "other depression" if they experienced between two to four depressive symptoms for “more than half the days” in the preceding two weeks, with at least one being depressed mood or anhedonia. The PHQ-8 classification "other depression" comprises the DSM-IV categories of dysthymia and depressive disorder, not otherwise specified, which includes minor or subthreshold depression [33]. For the comparison of depression prevalence between MMP and BRFSS, we conducted standardized comparisons for major depression, which is more severe and disabling than other forms of depression.

Analytical methods

For each of the two surveys, the distributions of demographic characteristics were first summarized with unweighted counts and weighted percentages with 95% confidence intervals (CI). Factors common to both surveillance systems were gender, age at the time of interview, race/ethnicity, and highest level of education attained. We additionally included time since HIV diagnosis and sexual orientation, which were only assessed in MMP. Next, the weighted prevalence and 95% CI of major, other, and any current depression among MMP participants were estimated overall and among the categories of demographic factors, analogous to published results for BRFSS in 2006 and 2008 [51], [52]. Comparisons between categories were made using the modified Rao-Scott χ2 Test [53].

To understand the degree to which the burden of major depression among HIV-infected adults receiving care is elevated compared to a probability sample drawn from the general U.S. population, we conducted stratified analyses that simultaneously controlled for gender and, in turn, one of the potentially confounding demographic factors of age, race/ethnicity, education, and income. The latter demographic factors were considered within gender categories because of the substantial differences in gender distribution between the two surveillance projects and the established relationship between gender and depression [2]. Within each stratum, we calculated the weighted prevalence and associated standard error (SE) of each depression outcome for both MMP and BRFSS. The weighted prevalences were compared between the two systems with prevalence ratios (PR). These stratum-specific estimates were then summarized with standardized prevalence ratios (SPRs) and their 95% CIs, utilizing the weighted prevalences and their SEs [54]. Thus, for each depression outcome, 4 SPRs were computed as the combinations of gender with age, race/ethnicity, education, or income. Together, these provided different perspectives of the excess in depression seen among HIV patients receiving care. This approach is an extension of the indirect method for calculating the age-adjusted standardized mortality ratios, in which the observed mortality rate in a population of interest is compared with an expected one derived from the age-specific mortality rates of a standard population [55]. With MMP as the population of interest and BRFSS as the standard population, factors known to be associated with depression were identified as key elements for standardization in our comparison, as explained above. To account for the complex survey designs, weighted analyses were conducted using PROC SURVEYFREQ in SAS 9.3 (SAS Institute, Cary, NC) for MMP data and SAS callable SUDAAN (RTI International, Research Triangle Park, NC) for BRFSS data. SPR calculations were performed in Microsoft Excel 2010 (Microsoft Corporation, Redmond, WA).

Although a high prevalence of depression has been observed among groups with increased risk for HIV, like men who have sex with men and injection drug users [12], [56][60], data were not available to adjust for these characteristics in our comparison of depression prevalence among MMP and BRFSS populations. However, we were able to determine the prevalence of depression among persons in the general population who reported one or more HIV risk behaviors, which might indicate that these individuals have an increased risk for HIV infection. To determine the presence of HIV risk behaviors, we analyzed responses to the following question, which was first included in the 2008 BRFSS core survey and was only directed to participants younger than 65 years of age: “I’m going to read you a list. When I’m done, please tell me if any of the situations apply to you. You do not need to tell me which one: 1) You have used intravenous drugs in the past year, 2) You have been treated for a sexually transmitted or venereal disease in the past year, 3) You have given or received money or drugs in exchange for sex in the past year, 4) You had anal sex without a condom in the past year. Do any of these situations apply to you?” [61]. The prevalence of major depression by gender and the presence of one or more HIV risk behaviors were calculated and summarized using unweighted counts and weighted percentages with 95% CI. Using the two-proportion Z test, statistical comparisons were made between the prevalence of major depression among persons in the general population with self-reported HIV risk behaviors and the prevalence of major depression in each of two other groups – persons in the general population who did not report such behaviors (BRFSS) and HIV-infected persons receiving care (MMP). These comparisons were made within gender categories to account for any gender-related difference in depression prevalence.

Results

Demographics

Among 4,217 MMP participants included in this analysis, 4,168 (98.7% of weighted sample) completed the PHQ-8 and comprised our analytic sample from MMP. As shown in Table 1, the largest proportions of the respondents who completed the PHQ-8 were male (71.2%), African-American (41.3%), and diagnosed with HIV at least 10 years previously (53.9%). A large proportion (59.1%) was age 45 or older, and only 14.2% was less than age 35. Although the largest proportion (49.3%) self-reported being heterosexual or straight, a considerable proportion (40.9%) reported being homosexual. The level of education was less than high school for 22.5%, and the annual household income was less than $10,000 for 34.5%.

thumbnail
Table 1. Self-reported characteristics of HIV-infected adults receiving medical care and general population adults in the United States who completed the Eight-item Patient Health Questionnaire depression scale — Medical Monitoring Project (MMP) 2009 and Behavioral Risk Factor Surveillance System (BRFSS), 2006 and 2008.

https://doi.org/10.1371/journal.pone.0092842.t001

Among 267,584 BRFSS participants who were offered participation in the Anxiety and Depression Module in 2006 or 2008, 235,067 (88.7% of weighted sample) completed the PHQ-8 and comprised the analytic sample from BRFSS. In contrast to the HIV-infected population receiving care, the largest proportion of the general population sample from BRFSS was female (51.4%) and white (70.5%). Less than half (48.5%) of the general population sample was age 45 or older, and a substantial proportion (31.3%) was younger than age 35. The level of education was less than high school for only 10.8%, and the annual household income was less than $10,000 for only 4.8% of the general population sample.

Depression prevalence

Depression was common among HIV-infected persons receiving care, with PHQ-8 responses indicating an estimated 12.4% (95% CI: 11.2%, 13.7%) prevalence of current major depression and 13.2% (95% CI: 12.0%, 14.4%) of other depression, yielding 25.6% (95% CI: 23.8%, 27.4%) with any current depression. Statistically significant heterogeneity in the prevalence of major depression was seen by levels of gender (p<0.0001), age (p = 0.005), education (p = 0.001) and annual income (p<0.0001). Major depression was most common among female (17.0%) and transgender (17.5%) participants and among those between 35 and 44 years old (15%), with less than a high school education (16.2%), or with an annual income less than $10,000 (16.5%)(Table 2). No association was observed between major depression and race/ethnicity, time since HIV diagnosis, or sexual orientation.

thumbnail
Table 2. Weighted percentage of HIV-infected adults receiving medical care in the United States who met criteria for current depression*, by type of depression and selected self-reported characteristics — Medical Monitoring Project, 2009.

https://doi.org/10.1371/journal.pone.0092842.t002

Based on BRFSS data, the prevalence of depression among general population adults was estimated to be 4.1% (95% CI: 3.9%, 4.2%) for current major depression and 5.1% (95% CI: 4.9%, 5.3%) for current other depression, yielding 9.1% (95% CI: 8.9%, 9.4%) for any current depression (Table S1), and variations across categories of gender, age, education, and annual income were similar to those seen among HIV-infected persons receiving care, as demonstrated by MMP data. In contrast to HIV-infected persons receiving care, however, statistically significant differences were seen across racial/ethnic groups, with a higher prevalence of major depression seen among non-Hispanic blacks (5.0%), Hispanics (4.7%), or non-Hispanic persons of other races (5.1%) than among white, non-Hispanic persons (3.7%) in the general population.

Comparison of depression prevalence (MMP and BRFSS)

Overall, the unadjusted prevalence ratio of current major depression among HIV-infected adults receiving care, compared to those in the general population, was 3.1. Similar results were observed when comparing the prevalence of current major depression across the two populations by gender, with the prevalence ratio being 3.2 for men and 3.5 for women.

Stratified comparisons of current major depression between MMP and BRFSS are presented in Table 3. Standardized prevalence ratios (SPR) that controlled for gender and each of the factors age, race/ethnicity, and education, indicated a prevalence of current major depression in MMP that was approximately three-fold (3.3, 3.0, and 2.9, respectively) that seen in BRFSS. When controlling for gender and annual income, the estimated excess burden of major depression was lower, with an SPR of 1.5.

thumbnail
Table 3. Relative and standardized prevalence of major depression by gender and four demographic characteristics — Medical Monitoring Project (MMP), 2009 and Behavioral Risk Factor Surveillance System (BRFSS), 2006 and 2008.

https://doi.org/10.1371/journal.pone.0092842.t003

These relationships were similar for the two additional depression outcomes considered. For current other depression, the SPR controlling for gender with age was 2.9 (95% CI: 2.6, 3.2), with race/ethnicity 2.1 (95% CI: 1.9, 2.4), with education 2.4 (95% CI: 2.2, 2.6), with income 1.6 (95% CI: 1.4, 1.8). Considering the outcome of any current depression, the SPR controlling for gender with age was 3.1 (95% CI: 2.9, 3.3), with race/ethnicity 2.5 (95% CI: 2.3, 2.7), with education 2.6 (95% CI: 2.4, 2.8), with income 1.5 (95% CI: 1.4, 1.7).

Sub-analysis of depression prevalence and HIV risk behaviors

Among 61,128 participants of the 2008 BRFSS survey <65 years of age who responded to the question about HIV risk behaviors, 1,475 (3.4% of weighted sample) reported they had one or more such behaviors in the preceding year. For male respondents, the prevalence of current major depression was 6.1% (95% CI: 3.9, 9.5) among 637 who reported having one or more HIV risk behaviors and 3.0% (95% CI: 2.6, 3.4) among 23,142 who did not report having such behaviors (p = 0.03). For female respondents, the prevalence of current major depression was 10.6% (95% CI: 7.6, 14.5) among 838 who reported having one or more HIV risk behaviors and 4.9% (95% CI: 4.4, 5.3) among 36,511 who did not report having such behaviors (p<0.01).

Men <65 years of age in the general population who reported one or more HIV risk behaviors had a lower prevalence of current major depression compared to men <65 years of age receiving care for HIV infection (6.1% vs. 10.6%, p<0.01). Women <65 years of age in the general population who reported one or more HIV risk behaviors had a lower prevalence of current major depression compared to women <65 years of age receiving care for HIV infection (10.6% vs. 17.0%, p<0.01).

Discussion

In this report we present the first nationally representative data available on depression among HIV-infected adults receiving care in the U.S. since the HIV Cost and Services Utilization Study (HCSUS) was conducted during 1994–2000 [62], and the largest analysis of such data to date. Based on data from the 2009 MMP cycle, among HIV-infected persons receiving outpatient care in the U.S., more than a quarter – or over 100,000 – had symptoms of any depression, including about 12% – or over 50,000 – with symptoms that were consistent with a current major depressive episode. Given the chronic and episodic nature of depression, the full burden of this condition over time is likely greater than is demonstrated by our estimates of current depression. Although not directly comparable, the one-year prevalence of major depression estimated by HCSUS (22%) was nearly twice as high as our MMP estimate for current major depression [62].

The high burden of depression among HIV-infected persons is more apparent when compared with that among the general population. Based on our data, the prevalence of current major depression among HIV-infected persons receiving outpatient care was over three times that seen in a general population sample from BRFSS. Further, similar excesses in major depression prevalence were seen by gender, and the higher relative prevalences among HIV-infected persons appeared to be primarily related to lower annual household income. Although the prevalence ratio for current major depression changed somewhat when the two populations were standardized to account for differences in gender and either age (SPR = 3.3), race/ethnicity (SPR = 3.0), or educational attainment (SPR = 2.9), it changed dramatically when standardized for gender and annual household income level (SPR = 1.5). Lower socioeconomic status, particularly poverty, is known to be associated with HIV infection and with depression [63][67], and the nature of these relationships is likely complicated. For example, income may be an indicator of the degree of access to health care resources, which may affect HIV-related knowledge and behaviors and the general health status of individuals. Poor health status – manifesting as chronic illnesses or as conditions that might lead to such illnesses – may contribute to the risk for depression, and depression, in turn, may contribute to poorer health and lower socioeconomic status [65], [68], [69].

In comparing the depression prevalence between HIV-infected persons and the general population, it was important to recognize the differences in demographics between these two populations and the need to account for them, because certain demographic groups in which depression prevalence is known to be higher (persons with low socioeconomic status) or lower (men) are over-represented among HIV-infected persons [63], [70]. The SPRs calculated from MMP and BRFSS data provided a useful way to perform such a comparison and to assess whether there was an excess burden of major depression among HIV-infected persons receiving care beyond what would be expected based on their demographic composition alone. Based on our findings, socioeconomic factors, particularly annual household income, were important confounding factors that should be taken into account in such comparisons.

Although lower income accounted for much of the excess major depression among HIV patients, it did not fully account for it. An excess in depression prevalence remained, whether the prevalence ratio was adjusted for race/ethnicity, education, or household income. When standardized for annual household income, there was approximately a 50% excess depression among HIV patients. This finding is consistent with that from some previous studies, including a meta-analysis that reported that the odds of recent depression (within the past 1 to 6 months) were 2 times as great among persons with HIV, compared to those without HIV, and that sexual orientation did not account for the excess in major depression among those with HIV [23]. Further, our analysis of available data from BRFSS indicated that although the prevalence of current major depression was estimated to be higher among those with ≥1 risk factors for HIV than among those without such risk factors, it was still lower than the observed prevalence among MMP participants (who were living with HIV). Taken together, these observations suggest that, although some excess in major depression may be explained by circumstances related to risks for HIV acquisition, factors associated with having HIV – as a chronic illness – are also associated with higher prevalence of major depression.

It is notable that our estimate of the prevalence of current major depression among HIV patients is comparable to estimates of current depression associated with common chronic medical conditions such as diabetes mellitus (DM)(6.3%–13.3%, PHQ-8 algorithm for current major depression[71]) and cardiovascular disease (15.8% among persons ≥45 years, PHQ-8 score ≥10 [72]). The association between chronic medical illnesses and depression has been well-recognized, but the reasons for this are not fully understood. Multiple contributing factors – psychosocial, behavioral, and biological – are likely involved, and cross-sectional studies cannot establish their temporal relationships. Factors that might lead to comorbid depression include physical symptoms, side effects of medications, social stigma associated with the illness, and social isolation due to symptom severity or disability [3], [59], [68], [73]. Depression, in turn, might increase the risk for development of a chronic illness, or exacerbate an underlying chronic illness through its impact on behaviors (e.g., substance abuse, treatment non-adherence)[3], [68], [74], [75]. Immunologic and endocrinologic changes that are observed more commonly in people with than without depression might increase the risk for some chronic medical conditions or lead to poorer outcomes among those with a chronic medical condition [76][79]. Therefore, the importance of screening for and treatment of depression is increasingly being recognized, especially in the context of HIV or other chronic medical conditions [80][85].

Some limitations should be considered in interpreting the results in this report. Because MMP participants were all sampled through medical care providers, our results are representative of persons receiving care for HIV infection, but not all HIV-infected persons. It is not clear how the exclusion of those not receiving care for HIV would affect the prevalence estimates for depression, because depression might manifest as either increased care seeking [86] or not engaging in care [74], [87]. The use of the PHQ-8 might have led to the overestimation or underestimation of the prevalence of major depression. Overestimation might result from the fact that the PHQ-8 is not equivalent to a full diagnostic interview, and, therefore, might include depressive episodes caused by underlying mental or physical illnesses other than major depression [33]. The focus on identifying current (past 2 weeks) depression, however, might have led to underestimating the prevalence of major depression. Although helpful in minimizing recall bias, such a short time frame might not allow the detection of depression among individuals whose symptoms remit and recur episodically over time. Underestimation of the prevalence of depression might also result from the fact that individuals who have received care for their HIV infection might have received care that was effective in controlling their depression as well.

Several limitations might have affected the PRs and SPRs in our comparisons between MMP and BRFSS data. We were not able to standardize specifically for sexual orientation or substance abuse in our comparisons, which might have led to an overestimation of the PRs and SPRs. Nevertheless, our finding regarding major depression among general population adults with ≥1 HIV risk behaviors suggested that factors related to such behaviors did not fully account for the higher burden of major depression seen among HIV-infected persons receiving care. The difference in modes of administration between MMP (in-person) and BRFSS (telephone), in addition, might have contributed to underestimation of the PRs and SPRs. In a previous comparison of data from two national surveys, the depression prevalence estimate measured by the PHQ-8 was found to be higher with telephone administration than with in-person administration [88].

Limitations with BRFSS data are related to two main issues. First, the increase in the number households with cellular telephones only and in telephone number portability continue to decrease BRFSS response rates, reducing the precision of state estimates and potentially introducing bias [89]. Second, because not all states participated, estimates might not be generalizable to the entire U.S. adult population. Furthermore, due to the cross-sectional design of MMP and BRFSS, we were not able to make inferences regarding causality or temporality.

Despite the limitations of our analysis, it is clear that depression is an important comorbidity among HIV patients. Based on our results, about one in eight patients in care for HIV had current symptoms consistent with major depression, and about one in four had current symptoms of any type of depression. Using representative data sources for HIV-infected persons in care and the general population, the unadjusted prevalence of major depression among those in care for HIV is over three times that among the general population. This large relative difference in depression prevalence appeared to be primarily related to differences in annual household income. However, even after standardizing for income level, a smaller but important residual excess in depression burden remained, suggesting there might be additional factors contributing to this excess burden among HIV-infected persons who are receiving care.

Our findings also indicate that despite the availability of effective treatment for depression, many HIV-infected persons had symptoms consistent with major depression, raising concern about access to care and quality of care. Although some clinical guidelines exist for depression screening that are specific to HIV care settings [81], [84], it is not clear how widely adopted they are among HIV care providers, but there is evidence that many persons who are in care for HIV infection have depression that is not recognized and treated by their HIV care providers [90], [91]. Given the complexity of HIV treatment, HIV care providers may need training on issues related to the clinical management of depression in their patients, who may be taking multiple medications with various side effects and the potential for drug interactions. In addition, models for incorporating the management of depression within the HIV medical home have been developed and may be an effective approach to consider in ensuring appropriate care for HIV patients with depression in settings where access to mental health care is limited [92]. As interest grows in improving HIV prevention through antiretroviral treatment, it becomes increasingly important to recognize the role of comorbid depression in HIV infection and to closely integrate the screening for and treatment of depression with routine clinical management of HIV. Furthermore, because not all HIV-infected persons are in care, considerations should also be given to incorporating depression screening and treatment into HIV prevention programs, particularly those that address issues among those who are socioeconomically disadvantaged [93], [94]. Because of the potential detrimental effect of depression on HIV prevention and on the clinical outcomes of HIV-infected persons, effective treatment and follow-up over time are essential to the effective management of this chronic and disabling condition, which continues to affect many persons living with HIV in the U.S.

Supporting Information

Table S1.

Weighted percentage of adults in the United States who meet criteria for current depression, by type of depression and selected characteristics - Behavioral Risk Factor Surveillance System, 2006 and 2008. wgt. % =  weighted %; SE  =  standard error; PR  =  prevalence ratio (unadjusted); SPR  =  standardized prevalence ratio; 95% CI = 95% confidence intervals. Responses to the Eight-item Patient Health Questionnaire were used to define “major depression” according to criteria from the Diagnostic and Statistical Manual of Mental Disorders, 4th Edition. Any depression is the presence of either major depression or other depression.

https://doi.org/10.1371/journal.pone.0092842.s001

(DOCX)

Acknowledgments

Disclaimer: The findings and conclusions in this report are those of the authors only and do not necessarily represent the views of the U.S. Centers for Disease Control and Prevention.

We would like to thank the MMP participants, the MMP field staff and members of the Community Advisory Board and Provider Advisory Board in the 23 participating project areas, the Data Coordinating Center for HIV Supplemental Surveillance at ICF International, and members of the Clinical Outcomes Team in CDC’s Behavioral and Clinical Surveillance Branch of the Division of HIV/AIDS Prevention, National Center for HIV/AIDS, Viral Hepatitis, STD and TB Prevention.

Author Contributions

Conceived and designed the experiments: AND ESR PSS JS. Analyzed the data: AND ESR PSS LB TWS JS. Wrote the paper: AND ESR PSS LB JDS JLF MSF JS.

References

  1. 1. Rabkin JG (2008) HIV and depression: 2008 review and update. Curr HIV/AIDS Rep 5: 163–171.
  2. 2. Sadock BJ, Sadock VA, Ruiz P (2009) Kaplan & Sadock's Comprehensive Tetbook of Psychiatry. Vol I. 9th ed. Philadelphia: Lippincott Williams & Wilkins.
  3. 3. Chander G, Himelhoch S, Moore RD (2006) Substance abuse and psychiatric disorders in HIV-positive patients: epidemiology and impact on antiretroviral therapy. Drugs 66: 769–789.
  4. 4. Horberg MA, Silverberg MJ, Hurley LB, Towner WJ, Klein DB, et al. (2008) Effects of depression and selective serotonin reuptake inhibitor use on adherence to highly active antiretroviral therapy and on clinical outcomes in HIV-infected patients. J Acquir Immune Defic Syndr 47: 384–390.
  5. 5. Yun LW, Maravi M, Kobayashi JS, Barton PL, Davidson AJ (2005) Antidepressant treatment improves adherence to antiretroviral therapy among depressed HIV-infected patients. J Acquir Immune Defic Syndr 38: 432–438.
  6. 6. Bouhnik AD, Preau M, Vincent E, Carrieri MP, Gallais H, et al. (2005) Depression and clinical progression in HIV-infected drug users treated with highly active antiretroviral therapy. Antivir Ther 10: 53–61.
  7. 7. Cook JA, Grey D, Burke J, Cohen MH, Gurtman AC, et al. (2004) Depressive symptoms and AIDS-related mortality among a multisite cohort of HIV-positive women. Am J Public Health 94: 1133–1140.
  8. 8. Ickovics JR, Hamburger ME, Vlahov D, Schoenbaum EE, Schuman P, et al. (2001) Mortality, CD4 cell count decline, and depressive symptoms among HIV-seropositive women: longitudinal analysis from the HIV Epidemiology Research Study. JAMA 285: 1466–1474.
  9. 9. Kiecolt-Glaser JK, Glaser R (2002) Depression and immune function: central pathways to morbidity and mortality. J Psychosom Res 53: 873–876.
  10. 10. Leserman J (2008) Role of depression, stress, and trauma in HIV disease progression. Psychosom Med 70: 539–545.
  11. 11. Page-Shafer K, Delorenze GN, Satariano WA, Winkelstein W Jr (1996) Comorbidity and survival in HIV-infected men in the San Francisco Men's Health Survey. Ann Epidemiol 6: 420–430.
  12. 12. Davis L, Uezato A, Newell JM, Frazier E (2008) Major depression and comorbid substance use disorders. Curr Opin Psychiatry 21: 14–18.
  13. 13. Atkinson JH Jr, Grant I, Kennedy CJ, Richman DD, Spector SA, et al. (1988) Prevalence of psychiatric disorders among men infected with human immunodeficiency virus. A controlled study. Arch Gen Psychiatry 45: 859–864.
  14. 14. Chuang HT, Jason GW, Pajurkova EM, Gill MJ (1992) Psychiatric morbidity in patients with HIV infection. Can J Psychiatry 37: 109–115.
  15. 15. Fukunishi I, Matsumoto T, Negishi M, Hayashi M, Hosaka T, et al. (1997) Somatic complaints associated with depressive symptoms in HIV-positive patients. Psychother Psychosom 66: 248–251.
  16. 16. Kelly B, Raphael B, Judd F, Perdices M, Kernutt G, et al. (1998) Psychiatric disorder in HIV infection. Aust N Z J Psychiatry 32: 441–453.
  17. 17. Lipsitz JD, Williams JB, Rabkin JG, Remien RH, Bradbury M, et al. (1994) Psychopathology in male and female intravenous drug users with and without HIV infection. Am J Psychiatry 151: 1662–1668.
  18. 18. Maj M, Janssen R, Starace F, Zaudig M, Satz P, et al. (1994) WHO Neuropsychiatric AIDS study, cross-sectional phase I. Study design and psychiatric findings. Arch Gen Psychiatry 51: 39–49.
  19. 19. Perkins DO, Stern RA, Golden RN, Murphy C, Naftolowitz D, et al. (1994) Mood disorders in HIV infection: prevalence and risk factors in a nonepicenter of the AIDS epidemic. Am J Psychiatry 151: 233–236.
  20. 20. Rabkin JG, Ferrando SJ, Jacobsberg LB, Fishman B (1997) Prevalence of axis I disorders in an AIDS cohort: a cross-sectional, controlled study. Compr Psychiatry 38: 146–154.
  21. 21. Rosenberger PH, Bornstein RA, Nasrallah HA, Para MF, Whitaker CC, et al. (1993) Psychopathology in human immunodeficiency virus infection: lifetime and current assessment. Compr Psychiatry 34: 150–158.
  22. 22. Williams JB, Rabkin JG, Remien RH, Gorman JM, Ehrhardt AA (1991) Multidisciplinary baseline assessment of homosexual men with and without human immunodeficiency virus infection. II. Standardized clinical assessment of current and lifetime psychopathology. Arch Gen Psychiatry 48: 124–130.
  23. 23. Ciesla JA, Roberts JE (2001) Meta-analysis of the relationship between HIV infection and risk for depressive disorders. Am J Psychiatry 158: 725–730.
  24. 24. McNaghten AD, Wolfe MI, Onorato I, Nakashima AK, Valdiserri RO, et al. (2007) Improving the representativeness of behavioral and clinical surveillance for persons with HIV in the United States: the rationale for developing a population-based approach. PLoS One 2: e550.
  25. 25. Blair JM, McNaghten AD, Frazier EL, Skarbinski J, Huang P, et al. (2011) Clinical and behavioral characteristics of adults receiving medical care for HIV infection --- Medical Monitoring Project, United States, 2007. MMWR Surveill Summ 60: 1–20.
  26. 26. Frankel MR, McNaghten A, Shapiro MF, Sullivan PS, Berry SH, et al. (2012) A Probability Sample for Monitoring the HIV-infected Population in Care in the U.S. and in Selected States. Open AIDS J 6: 67–76.
  27. 27. U.S. Department of Health and Human Services (2009) Protection of Human Subjects, Title 45 Code of Federal Regulations, Pt 46.
  28. 28. Centers for Disease Control and Prevention (1999) Guidelines for Public Health Research and Public Health Non-Research.
  29. 29. Department of Health and Human Services CfDCaP (2012) Behavioral Risk Factor Surveillance System: Operational and User's Guide.
  30. 30. Centers for Disease Control and Prevention (2003) Public health surveillance for behavioral risk factors in a changing environment. Recommendations from the Behavioral Risk Factor Surveillance Team. MMWR Recomm Rep 52: 1–12.
  31. 31. Holtzman D (2004) The Behavioral Risk Factor Surveillance System. In: Blumenthal DS DR, editors. Community-Based Health Research: Issues and Methods. New York: Springer Publishing Company. pp. 115–132.
  32. 32. Reeves WC, Strine TW, Pratt LA, Thompson W, Ahluwalia I, et al. (2011) Mental illness surveillance among adults in the United States. MMWR Surveill Summ 60 Suppl 3 1–29 1–29.
  33. 33. American Psychiatric Association (2000) Diagnostic and statistical manual of mental disorders. Washington, D.C.
  34. 34. Kroenke K, Spitzer RL, Williams JB (2001) The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 16: 606–613.
  35. 35. Corson K, Gerrity MS, Dobscha SK (2004) Screening for depression and suicidality in a VA primary care setting: 2 items are better than 1 item. Am J Manag Care 10: 839–845.
  36. 36. Razykov I, Ziegelstein RC, Whooley MA, Thombs BD (2012) The PHQ-9 versus the PHQ-8—is item 9 useful for assessing suicide risk in coronary artery disease patients? Data from the Heart and Soul Study. J Psychosom Res 73: 163–168.
  37. 37. Kroenke K, Spitzer RL, Williams JB, Lowe B (2010) The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. Gen Hosp Psychiatry 32: 345–359.
  38. 38. Wells TS, Horton JL, Leardmann CA, Jacobson IG, Boyko EJ (2012) A comparison of the PRIME-MD PHQ-9 and PHQ-8 in a large military prospective study, the Millennium Cohort Study. J Affect Disord.
  39. 39. Grattan A, Sullivan MD, Saunders KW, Campbell CI, Von Korff MR (2012) Depression and prescription opioid misuse among chronic opioid therapy recipients with no history of substance abuse. Ann Fam Med 10: 304–311.
  40. 40. Mussell M, Kroenke K, Spitzer RL, Williams JB, Herzog W, et al. (2008) Gastrointestinal symptoms in primary care: prevalence and association with depression and anxiety. J Psychosom Res 64: 605–612.
  41. 41. Nease DE Jr, Aikens JE, Klinkman MS, Kroenke K, Sen A (2011) Toward a more comprehensive assessment of depression remission: the Remission Evaluation and Mood Inventory Tool (REMIT). Gen Hosp Psychiatry 33: 279–286.
  42. 42. Spitzer RL, Williams JB, Kroenke K, Hornyak R, McMurray J (2000) Validity and utility of the PRIME-MD patient health questionnaire in assessment of 3000 obstetric-gynecologic patients: the PRIME-MD Patient Health Questionnaire Obstetrics-Gynecology Study. Am J Obstet Gynecol 183: 759–769.
  43. 43. Spitzer RL, Kroenke K, Williams JB (1999) Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA 282: 1737–1744.
  44. 44. Diez-Quevedo C, Rangil T, Sanchez-Planell L, Kroenke K, Spitzer RL (2001) Validation and utility of the patient health questionnaire in diagnosing mental disorders in 1003 general hospital Spanish inpatients. Psychosom Med 63: 679–686.
  45. 45. Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, et al. (2009) The PHQ-8 as a measure of current depression in the general population. J Affect Disord 114: 163–173.
  46. 46. Martin A, Rief W, Klaiberg A, Braehler E (2006) Validity of the Brief Patient Health Questionnaire Mood Scale (PHQ-9) in the general population. Gen Hosp Psychiatry 28: 71–77.
  47. 47. Rief W, Nanke A, Klaiberg A, Braehler E (2004) Base rates for panic and depression according to the Brief Patient Health Questionnaire: a population-based study. J Affect Disord 82: 271–276.
  48. 48. Mohr DC, Duffecy J, Jin L, Ludman EJ, Lewis A, et al. (2010) Multimodal e-mental health treatment for depression: a feasibility trial. J Med Internet Res 12: e48.
  49. 49. Pinto-Meza A, Serrano-Blanco A, Penarrubia MT, Blanco E, Haro JM (2005) Assessing depression in primary care with the PHQ-9: can it be carried out over the telephone? J Gen Intern Med 20: 738–742.
  50. 50. Huang FY, Chung H, Kroenke K, Delucchi KL, Spitzer RL (2006) Using the Patient Health Questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. J Gen Intern Med 21: 547–552.
  51. 51. Centers for Disease Control and Prevention (2010) Current depression among adults---United States, 2006 and 2008. MMWR Morb Mortal Wkly Rep 59: 1229–1235.
  52. 52. Centers for Disease Control and Prevention (2011) Erratum. Current depression among adults---United States, 2006 and 2008. MMWR Morb Mortal Wkly Rep 60: 518.
  53. 53. Rao JNK SA (1987) On simple adjustments to chi-squared tests with survey data. Annals of Statistics 15: 385–397.
  54. 54. Rothman KJ, Greenland S, Lash TL (2008) Modern Epidemiology. Philadelphia: Lippincott Williams & Wilkins.
  55. 55. Goldman DA, Brender JD (2000) Are standardized mortality ratios valid for public health data analysis? Stat Med 19: 1081–1088.
  56. 56. King M, Semlyen J, Tai SS, Killaspy H, Osborn D, et al. (2008) A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry 8: 70.
  57. 57. Sandfort TG, de GR, Bijl RV, Schnabel P (2001) Same-sex sexual behavior and psychiatric disorders: findings from the Netherlands Mental Health Survey and Incidence Study (NEMESIS). Arch Gen Psychiatry 58: 85–91.
  58. 58. Perdue T, Hagan H, Thiede H, Valleroy L (2003) Depression and HIV risk behavior among Seattle-area injection drug users and young men who have sex with men. AIDS Educ Prev 15: 81–92.
  59. 59. Risser J, Cates A, Rehman H, Risser W (2010) Gender differences in social support and depression among injection drug users in Houston, Texas. Am J Drug Alcohol Abuse 36: 18–24.
  60. 60. Williams CT, Latkin CA (2005) The role of depressive symptoms in predicting sex with multiple and high-risk partners. J Acquir Immune Defic Syndr 38: 69–73.
  61. 61. Centers for Disease Control and Prevention (2007) 2008 Behavioral Risk Factor Surveillance System Questionnaire.
  62. 62. Frankel MR, Shapiro MF, Duan N, Morton SC, Berry SH, et al. (1999) National probability samples in studies of low-prevalence diseases. Part II: Designing and implementing the HIV cost and services utilization study sample. Health Serv Res 34: 969–992.
  63. 63. Centers for Disease Control and Prevention (2011) Characteristics associated with HIV infection among heterosexuals in urban areas with high AIDS prevalence --- 24 cities, United States, 2006–2007. MMWR Morb Mortal Wkly Rep 60: 1045–1049.
  64. 64. Holtgrave DR, Crosby RA (2003) Social capital, poverty, and income inequality as predictors of gonorrhoea, syphilis, chlamydia and AIDS case rates in the United States. Sex Transm Infect 79: 62–64.
  65. 65. Lewis G, Araya R (2001) Classification, disability and the public health agenda. Br Med Bull 57: 3–15.
  66. 66. Poundstone KE, Strathdee SA, Celentano DD (2004) The social epidemiology of human immunodeficiency virus/acquired immunodeficiency syndrome. Epidemiol Rev 26 22–35 22–35.
  67. 67. Bruce ML, Takeuchi DT, Leaf PJ (1991) Poverty and psychiatric status. Longitudinal evidence from the New Haven Epidemiologic Catchment Area study. Arch Gen Psychiatry 48: 470–474.
  68. 68. Cassano P, Fava M (2002) Depression and public health: an overview. J Psychosom Res 53: 849–857.
  69. 69. Kessler RC (2012) The costs of depression. Psychiatr Clin North Am 35: 1–14.
  70. 70. Centers for Disease Control and Prevention (2012) HIV Surveillance Report. 2010: 22.
  71. 71. Li C, Ford ES, Strine TW, Mokdad AH (2008) Prevalence of depression among U.S. adults with diabetes: findings from the 2006 behavioral risk factor surveillance system. Diabetes Care 31: 105–107.
  72. 72. Fan AZ, Strine TW, Jiles R, Mokdad AH (2008) Depression and anxiety associated with cardiovascular disease among persons aged 45 years and older in 38 states of the United States, 2006. Prev Med 46: 445–450.
  73. 73. Lichtenstein B, Laska MK, Clair JM (2002) Chronic sorrow in the HIV-positive patient: issues of race, gender, and social support. AIDS Patient Care STDS 16: 27–38.
  74. 74. Bhatia R, Hartman C, Kallen MA, Graham J, Giordano TP (2011) Persons newly diagnosed with HIV infection are at high risk for depression and poor linkage to care: results from the Steps Study. AIDS Behav 15: 1161–1170.
  75. 75. Traeger L, O'Cleirigh C, Skeer MR, Mayer KH, Safren SA (2011) Risk factors for missed HIV primary care visits among men who have sex with men. J Behav Med.
  76. 76. Howren MB, Lamkin DM, Suls J (2009) Associations of depression with C-reactive protein, IL-1, and IL-6: a meta-analysis. Psychosom Med 71: 171–186.
  77. 77. Evans DL, Ten Have TR, Douglas SD, Gettes DR, Morrison M, et al. (2002) Association of depression with viral load, CD8 T lymphocytes, and natural killer cells in women with HIV infection. Am J Psychiatry 159: 1752–1759.
  78. 78. Silverman MN, Sternberg EM (2012) Glucocorticoid regulation of inflammation and its functional correlates: from HPA axis to glucocorticoid receptor dysfunction. Ann N Y Acad Sci 1261: 55–63.
  79. 79. Cruess DG, Petitto JM, Leserman J, Douglas SD, Gettes DR, et al. (2003) Depression and HIV infection: impact on immune function and disease progression. CNS Spectr 8: 52–58.
  80. 80. Evans DL, Charney DS, Lewis L, Golden RN, Gorman JM, et al. (2005) Mood disorders in the medically ill: scientific review and recommendations. Biol Psychiatry 58: 175–189.
  81. 81. New York State Department of Health (2010) Depression and mania in patients with HIV/AIDS (Guidelines).
  82. 82. Lichtman JH, Bigger JT Jr, Blumenthal JA, Frasure-Smith N, Kaufmann PG, et al. (2009) AHA science advisory. Depression and coronary heart disease. Recommendations for screening, referral, and treatment. A science advisory from the American Heart Association Prevention Committee to the Council on Cardiovascular Nursing, Council on Clinical Cardiology, Council on Epidemiology and Prevention, and Interdisciplinary Council on Quality of Care Outcomes Research. Endorsed by the American Psychiatric Association. Prog Cardiovasc Nurs 24: 19–26.
  83. 83. Centers for Disease Control and Prevention (CDC), Health Resources and Services Administration, National Institutes of Health, HIV Medicine Association of the Infectious Diseases Society of America (2003) Incorporating HIV prevention into the medical care of persons living with HIV. Recommendations of CDC, the Health Resources and Services Administration, the National Institutes of Health, and the HIV Medicine Association of the Infectious Diseases Society of America. MMWR Recomm Rep 52: 1–24.
  84. 84. Aberg JA, Kaplan JE, Libman H, Emmanuel P, Anderson JR, et al. (2009) Primary care guidelines for the management of persons infected with human immunodeficiency virus: 2009 update by the HIV medicine Association of the Infectious Diseases Society of America. Clin Infect Dis 49: 651–681.
  85. 85. Katon W, Lin EH, Von KM, Ciechanowski P, Ludman E, et al. (2010) Integrating depression and chronic disease care among patients with diabetes and/or coronary heart disease: the design of the TEAMcare study. Contemp Clin Trials 31: 312–322.
  86. 86. Katon W, Schulberg H (1992) Epidemiology of depression in primary care. Gen Hosp Psychiatry 14: 237–247.
  87. 87. Lepine JP, Gastpar M, Mendlewicz J, Tylee A (1997) Depression in the community: the first pan-European study DEPRES (Depression Research in European Society). Int Clin Psychopharmacol 12: 19–29.
  88. 88. Li C, Ford ES, Zhao G, Tsai J, Balluz LS (2012) A comparison of depression prevalence estimates measured by the Patient Health Questionnaire with two administration modes: computer-assisted telephone interviewing versus computer-assisted personal interviewing. Int J Public Health 57: 225–233.
  89. 89. Link MW, Battaglia MP, Frankel MR, Osborn L, Mokdad AH (2007) Reaching the U.S. cell phone generation. Public Opin Q 71: 814–839.
  90. 90. Asch SM, Kilbourne AM, Gifford AL, Burnam MA, Turner B, et al. (2003) Underdiagnosis of depression in HIV: who are we missing? J Gen Intern Med 18: 450–460.
  91. 91. Rodkjaer L, Laursen T, Balle N, Sodemann M (2010) Depression in patients with HIV is under-diagnosed: a cross-sectional study in Denmark. HIV Med 11: 46–53.
  92. 92. Adams JL, Gaynes BN, McGuinness T, Modi R, Willig J, et al. (2012) Treating Depression Within the HIV "Medical Home": A Guided Algorithm for Antidepressant Management by HIV Clinicians. AIDS Patient Care STDS 26: 647–654.
  93. 93. Johnson V (2011) Advancing Economic Opportunities for Women Living with HIV/AIDS One Microenterprise Circle at a Time. National HIV Prevention Conference 5.
  94. 94. Stratford D, Mizuno Y, Williams K, Courtenay-Quirk C, O'leary A (2008) Addressing poverty as risk for disease: recommendations from CDC's consultation on microenterprise as HIV prevention. Public Health Rep 123: 9–20.