Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Comparison of Mental Health Symptoms prior to and during COVID-19: Evidence from a Living Systematic Review and Meta-analysis

Ying Sun, Yin Wu, Olivia Bonardi, Ankur Krishnan, Chen He, Jill T. Boruff, Danielle B. Rice, Yutong Wang, Xiaowen Jiang, Kexin Li, Sarah Markham, Brooke Levis, Marleine Azar, Ian Thombs-Vite, Dipika Neupane, Tiffany Dal Santo, Amina Tasleem, Anneke Yao, Branka Agic, Christine Fahim, Michael S. Martin, Sanjeev Sockalingam, Gustavo Turecki, Andrea Benedetti, Brett D. Thombs
doi: https://doi.org/10.1101/2021.05.10.21256920
Ying Sun
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yin Wu
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
2Department of Psychiatry, McGill University, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Olivia Bonardi
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ankur Krishnan
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chen He
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jill T. Boruff
3Schulich Library of Physical Sciences, Life Sciences, and Engineering, McGill University, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Danielle B. Rice
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
4Department of Psychology, McGill University, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yutong Wang
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Xiaowen Jiang
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kexin Li
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sarah Markham
5Department of Biostatistics and Health Informatics, King’s College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brooke Levis
6Centre for Prognosis Research, School of Medicine, Keele University, Staffordshire, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marleine Azar
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian Thombs-Vite
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dipika Neupane
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tiffany Dal Santo
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
4Department of Psychology, McGill University, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Amina Tasleem
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
4Department of Psychology, McGill University, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anneke Yao
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
4Department of Psychology, McGill University, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Branka Agic
7Centre for Addiction and Mental Health, Toronto, Ontario, Canada
8Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christine Fahim
9Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael S. Martin
10School of Epidemiology and Public Health, University of Ottawa; Ontario, Canada
11Correctional Service of Canada, Ottawa, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sanjeev Sockalingam
7Centre for Addiction and Mental Health, Toronto, Ontario, Canada
12Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gustavo Turecki
2Department of Psychiatry, McGill University, Montréal, Québec, Canada
13McGill Group for Suicide Studies, Douglas Mental Health University Institute, McGill University, Montreal, Quebec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrea Benedetti
14Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
15Department of Medicine, McGill University, Montréal, Québec, Canada
16Respiratory Epidemiology and Clinical Research Unit, McGill University Health Centre, Montréal, Québec, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brett D. Thombs
1Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
2Department of Psychiatry, McGill University, Montréal, Québec, Canada
4Department of Psychology, McGill University, Montréal, Québec, Canada
14Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
15Department of Medicine, McGill University, Montréal, Québec, Canada
17Department of Educational and Counselling Psychology, McGill University, Montréal, Québec, Canada;
18Biomedical Ethics Unit, McGill University, Montréal, Québec, Canada.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: brett.thombs@mcgill.ca
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Objectives The rapid pace, high volume, and limited quality of mental health evidence being generated during COVID-19 poses a barrier to effective decision-making. The objective of the present report is to compare mental health outcomes assessed during COVID-19 to outcomes prior to COVID-19 in the general population and other population groups.

Design Living systematic review.

Data Sources MEDLINE (Ovid), PsycINFO (Ovid), CINAHL (EBSCO), EMBASE (Ovid), Web of Science Core Collection: Citation Indexes, China National Knowledge Infrastructure, Wanfang, medRxiv (preprints), and Open Science Framework Preprints (preprint server aggregator). The initial search was conducted on April 13, 2020 with ongoing weekly updates.

Eligibility criteria for selecting studies For this report, we included studies that compared general mental health, anxiety symptoms, or depression symptoms, assessed January 1, 2020 or later, to the same outcomes collected between January 1, 2018 and December 31, 2019. We required ≥ 90% of participants pre-COVID-19 and during COVID-19 to be the same or the use of statistical methods to address missing data. For population groups with continuous outcomes for at least three studies in an outcome domain, we conducted restricted maximum-likelihood random-effects meta-analyses.

Results As of March 22, 2021, we had identified 36 unique eligible studies with data from 33 cohorts. All reported COVID-19 outcomes between March and June 2020, and 3 studies also reported outcomes between September and November 2020. Estimates of changes in general mental health were close to zero in the general population (standardized mean difference [SMD] = 0.02, 95% CI -0.11 to 0.16, I2 = 94.6%; 4 studies, N = 19,707) and among older adults (SMD = 0.02, 95% CI -0.11 to 0.16, I2 = 90.4%; 4 studies, N = 5,520) and university students (SMD = -0.01, 95% CI -0.33 to 0.30, I2 = 92.0%; 3 studies, N = 3,372). Changes in anxiety symptoms were close to zero and not statistically significant in university students (SMD = 0.00, 95% CI - 0.35 to 0.36, I2 = 95.4%; 5 studies, N = 1,537); women or females (SMD = 0.02, 95% CI -0.35 to 0.39, I2 = 92.3%; 3 studies, N = 2,778); and men or males (SMD = 0.07, 95% CI -0.01 to 0.15; I2 = 0.01%; 3 studies, N = 1,250); anxiety symptoms increased, however, among people with pre-existing medical conditions (SMD = 0.27, 95% CI 0.01 to 0.54, I2 = 91.0%; 3 studies, N = 2,053). Changes in depression symptoms were close to zero or small and not statistically significant among university students (SMD = 0.19, 95% CI -0.08 to 0.45, I2 = 91.8%; 5 studies, N = 1,537); people with pre-existing medical conditions (SMD = 0.01, 95% CI -0.15 to 0.17, I2 = 14.9%; 3 studies, N = 2,006); women or females (SMD = 0.21, 95% CI -0.14 to 0.55, I2 = 91.2%; 3 studies, N = 2,843); and men or males (SMD = 0.00, 95% CI -0.21 to 0.22; I2 = 92.3%; 4 studies, N = 3,661). In 3 studies with data from both March to June 2020 and September to November 2020, symptoms were unchanged from pre-COVID-19 at both time points or there were increases at the first assessment that had largely dissipated by the second assessment.

Conclusions Evidence does not suggest a widespread negative effect on mental health symptoms in COVID-19, although it is possible that gaps in data have not allowed identification of changes in some vulnerable groups. Continued updating is needed as evidence accrues.

Funding Canadian Institutes of Health Research (CMS-171703; MS1-173070); McGill Interdisciplinary Initiative in Infection and Immunity Emergency COVID-19 Research Fund (R2-42).

Registration PROSPERO (CRD42020179703); registered on April 17, 2020.

The SARS-CoV-2 coronavirus disease (COVID-19) pandemic has led to over 3 million deaths worldwide.1 It has disrupted lives of people around the world due to its rapid spread, mortality, disruption of the social fabric, toll on health care systems, and devastating economic impact.2, 3 There is concern about effects on mental health, particularly among vulnerable populations.

The sheer volume and low quality of information on mental health in COVID-19 being generated and disseminated through academic channels and the media, however, poses a substantial barrier to effective synthesis and decision-making.4, 5 Thousands of cross-sectional studies have published proportions of participants with scores above thresholds on easy-to-administer mental health measures and interpreted results as “prevalence” of mental health problems, attributable to COVID-19.4 These measures, however, are not intended for this purpose. Rather, thresholds on these measures are typically set to cast a wide net for screening, and proportions of people above thresholds dramatically overestimate prevalence compared to validated methods based on diagnostic interviews.6–10 In normal times, proportions of people above thresholds vary dramatically, even when the same measure and threshold are used. For example, the proportion of participants with scores of 10 or higher on the Patient Health Questionnaire-9 (PHQ-9),11 a commonly used depression symptom measure, in large, randomly selected, regional or national general population samples pre-COVID-19, has been reported as 4% in Hong Kong (N = 6,028);12 6% in Germany (N = 5,018);13 7% in Shanghai, China (N = 1,045);14 8% in the United States (N = 10,257);15 8% in Alberta, Canada (N = 3,304);16 11% in Sweden (N = 3,001);17 and 22% in Jiangsu, China (N = 8,400).18 Making matters worse, hundreds of different measure and threshold combinations are being used to report “prevalence”. Further compounding this problem, media stories have uncritically reported results from unvalidated survey tools or single items that inquire about mental health and well-being in COVID-19 and concluded that we are experiencing a “mental health pandemic” or “tsunami” of mental health consequences from COVID-19.19

Evidence from longitudinal cohorts that compare mental health symptoms from prior to COVID-19 to assessments done during the pandemic is critically needed to assess the degree of mental health changes, the nature of any changes, and who may be affected. Many systematic reviews have been published on mental health symptoms in COVID-19; however, all that we have identified have reported proportions of participants above questionnaire thresholds in cross-sectional studies.

We are conducting a series of living systematic reviews20 on mental health in COVID-19, including a review of longitudinal studies that compare mental health in COVID-19 to mental health prior to the pandemic or across points during the pandemic.4, 21 Living systematic reviews20 are logistically challenging but highly valuable when (1) important decisions to be made merit the resources involved; (2) low-certainty in existing evidence poses a barrier to decision-making; and (3) emerging evidence may inform decisions, as is the case for mental health in COVID-19.

The objective of the present report is to evaluate changes in mental health symptoms in COVID-19 by comparing studies with outcomes assessed during COVID-19 to outcomes from the same cohort of participants prior to COVID-19 in the general population and other population groups.

METHODS

Our set of systematic reviews on mental health in COVID-19, which include longitudinal studies of symptoms and studies of interventions, were registered together in the PROSPERO prospective register of systematic reviews (CRD 42020179703). A protocol was uploaded to the Open Science Framework (https://osf.io/96csg/) prior to initiation.22 Results from studies included in our reviews are posted online (https://www.depressd.ca/covid-19-mental-health).4 The present report is a subset of the overall review of longitudinal studies and includes evidence from studies that assessed general mental health, anxiety symptoms, or depression symptoms during COVID-19 and prior to the pandemic. Results are reported in accordance with the PRISMA statement.23

Eligible Studies

Studies on any population were included in the present report if they compared eligible outcomes collected between January 1, 2018 and December 31, 2019, when China first reported COVID-19 to the World Health Organization,24 to the same outcomes collected January 1, 2020 or later. We required studies to report data from comparison samples with at least 90% of the same participants pre-and during COVID-19 or to use statistical methods to account for missing participant data. Studies with < 100 participants were excluded due to their limited value for estimating changes.

Eligible outcomes in our main systematic review of longitudinal studies included (1) continuous scores on a validated mental health symptom questionnaire; (2) the proportion of participants above a threshold on a validated mental health symptom questionnaire; and (3) the proportion of participants meeting diagnostic criteria for a mental disorder using a validated diagnostic interview. In our main systematic review, mental health outcomes were defined broadly to include, for example, symptoms of anxiety, symptoms of depression, general mental health, stress, loneliness, anger, grief, burnout, other emotional disturbances, and emotional well-being. In the present report, we included only general mental health, anxiety symptoms, and depression symptoms because relatively few studies reported on other outcome domains. General mental health included measures of mental health quality of life, general symptoms or well-being, and combined symptom domains (e.g., symptoms of anxiety and depression). Results from other outcome domains are available online (https://www.depressd.ca/covid-19-mental-health).

Identification and Selection of Eligible Studies

The same search strategies were used for all research questions in our systematic reviews. We searched MEDLINE (Ovid), PsycINFO (Ovid), CINAHL (EBSCO), EMBASE (Ovid), Web of Science Core Collection: Citation Indexes, China National Knowledge Infrastructure, Wanfang, medRxiv (preprints), and Open Science Framework Preprints (preprint server aggregator), using a search strategy designed and built by an experienced health sciences librarian. The China National Knowledge Infrastructure and Wanfang databases were searched using Chinese search terms chosen based on our English-language search strategy. The speed of the project launch did not allow for formal search strategy peer review; however, COVID-19 terms were developed in collaboration with other librarians working on the topic. See Supplementary Material 1 for all search strategies. Our initial search was conducted from December 31, 2019 to April 13, 2020, then automated searches were set for daily updates. On December 28, 2020, we converted to weekly updates to improve processing efficiency.

Search results were uploaded into the systematic review software DistillerSR (Evidence Partners, Ottawa, Canada), where duplicate references were identified and removed. Two independent reviewers evaluated titles and abstracts in random order. If either reviewer deemed a study potentially eligible, a full-text review was completed, also by two independent reviewers. Discrepancies at the full-text level were resolved through consensus, with a third investigator consulted as necessary. To ensure accurate identification of eligible studies, a coding guide with inclusion and exclusion criteria was developed and pre-tested, and all team members were trained over several sessions. See Supplementary Material 2.

Data Extraction and Synthesis

For each included study, one reviewer extracted data using a pre-specified standardized form, and a second reviewer validated the extracted data using the DistillerSR Quality Control function. Reviewers extracted (1) publication characteristics (e.g., first author, publication year, journal); (2) population characteristics and demographics, including study eligibility criteria, recruitment method, number of participants, timing of assessments, age, and population group (general population, older adults, young adults, children and adolescents, parents, university students, people with pre-existing medical conditions, medical staff, and groups defined by sex or gender with studies in present report); (3) mental health assessment measures and outcomes; and (4) adequacy of study methods and reporting. Adequacy of study methods and reporting was assessed using an adapted version of the Joanna Briggs Institute Checklist for Prevalence Studies, which included items that assessed the appropriateness of the sampling frame for the target population, appropriateness of recruiting methods, adequacy of sample size, description of setting and participants, participation or response rate, methods for outcome assessment, standardization of assessments across participants, appropriateness of statistical analyses, and follow-up rate.25 See Supplementary Material 3.

For each continuous outcome, we extracted a standardized mean difference (SMD) effect size with 95% confidence intervals (CIs) for the change from pre-COVID-19 to during COVID-19. If not provided, we calculated it using Hedges’ g26 as g = meanchange/standard deviationwithin x the Hedges’ g adjustment factor, as described by Borenstein et al.27 In this report, we present SMDs as positive when mental health worsened from pre-COVID-19 to COVID-19 and negative when it improved. For proportions, if 95% CIs were not reported, we generated them. For point estimates pre-COVID-19 and during COVID-19, we used Agresti and Coull’s approximate method for binomial proportions.28 For changes in proportions, we used Newton’s method for differences between binomial proportions based on paired data.29 We assumed that 50% of cases pre-COVID-19 continued to be cases during COVID-19 and confirmed that results did not differ substantively if we used values from 30% to 70%.

We prioritized continuous data when both continuous and dichotomous results were reported due to pitfalls in interpreting proportions of participants crossing a dichotomous threshold. See Box 1 on interpreting outcomes from mental health symptom measures. For each population group with continuous outcomes for at least three studies in an outcome domain, SMDs were pooled across studies via restricted maximum-likelihood random-effects meta-analysis. Heterogeneity was assessed with the I2 statistic. For studies where more than one continuous outcome in a domain was assessed (e.g., two depression symptom measures), we pooled the relevant SMDs prior to fitting the meta-analysis, so that each study contributed only one observation. For one study30 that calculated change based on both a difference with the last pre-COVID-19 cohort assessment and via a fixed effects regression that included all pre-COVID-19 assessments, we included simple difference-based estimates in our meta-analyses. Meta-analysis was performed in R (R version 3.6.3, RStudio Version 1.2.5042), using the rma.uni function in the metafor package.31 Forest plots were generated using the forest.rma function in metafor.

Box 1.

Interpreting SMD Effect Sizes and Changes in Proportion Above a Threshold on Mental Health Measures

Symptom changes assessed with mental health patient-reported outcome measures in COVID-19 have been reported as changes in continuous scores and the proportion of study participants above a threshold. Continuously measured symptom changes are presented in terms of SMDs, which describe change in terms of within-group standard deviations, rather than raw change scores, which are measure-specific and not easily compared across measures. To illustrate, Box 1 – Figure 1 illustrates the amount of change, assuming a normal distribution, for SMD = 0.25. The hypothetical blue distribution represents pre-COVID-19 scores, and the grey distribution represents post-COVID-19 scores with a mean symptom increase of SMD = 0.25.

Box 1 – Figure 1.
  • Download figure
  • Open in new tab
Box 1 – Figure 1.

Illustration of change of 0.25 standardized mean difference effect size from hypothetical pre-COVID-19 (blue) to COVID-19 (black) symptom distributions. With a threshold located at one standard deviation above the pre-COVID-19 mean, the proportion of participants above the threshold would change from 16% to 23%. With a threshold two standard deviations above the pre-COVID-19 mean, the proportion would change from 2% to 4%.

When studies report an increase or decrease in the proportion of participants above a measure threshold, dichotomous thresholds used for this purpose are sometimes labelled as thresholds for “clinically significant” symptoms or as reflecting the presence of a condition (e.g., depression).6 These designations, are not, however, based on evidence that a threshold represents a meaningful divide between impairment and non-impairment and do not reflect the presence of a mental disorder. Most commonly, they reflect a point on a measure that balances sensitivity and specificity when used for screening, which does not inform when score levels might become clinically meaningful.6–10

Thresholds on different symptom measures are often located at different places in the symptom distribution. This can lead to divergent estimates of proportions crossing a threshold, depending on the measure used, rather than because of actual differences in symptom changes. As shown in Box 1 – Figure 1, the same change in symptoms in a hypothetical study sample would result in a 7% increase in participants at or above the threshold on one measure (black line, one standard deviation above pre-COVID-19 distribution mean) but an increase of only 2% on another (red line, two standard deviations above pre-COVID-19 distribution mean).

We have prioritized interpretation of continuous score changes. We have also reported proportions above thresholds, as they can be informative, such as when they are reported for two time points in the same study or as an indicator if some level of change may have occurred. We have, however, avoided interpretation of the magnitudes of proportions above thresholds.

Patient and Public Involvement

Dr. Sarah Markham, who is an experienced patient advisor and member of BMJ’s International Patient Panel, was included as a member of the research team from the inception of the project. She provided input on the project design, underwent training on procedures used in the study, and was involved in selection of eligible studies. She reviewed and provided comments on the content of this article.

Amendments to Protocol

Our systematic review was quickly designed and initiated in April 2020, and several amendments or clarifications were made. First, we changed from daily to weekly search updates on December 28, 2020 for more efficient reference processing. Second, on January 27, 2021 we made a minor change to search strategies to incorporate a new physical distancing subject heading created for COVID-19. Third, we made several amendments to Chinese-language search strategies to facilitate processing (see Supplementary Material 1). Fourth, we added a criterion to stipulate that eligible pre-COVID-19 assessments had to be completed between January 1, 2018 and December 31, 2019. We added this criterion because we had not anticipated comparisons of outcomes during COVID-19 to outcomes assessed many years prior, which in some cases occurred during a different developmental life stage.

RESULTS

Search Results and Selection of Eligible Studies

As of March 22, 2021, we had identified 45,777 unique titles and abstracts from our database search. Of these, we excluded 45,251 after title and abstract review and 394 after full-text review, leaving 132 studies with longitudinal data collection. Of those, 85 studies only assessed outcomes longitudinally during the pandemic period and did not include pre-COVID-19 data, 2 studies only assessed outcomes (e.g., loneliness) not included in the present report, 3 studies only collected pre-COVID-19 data prior to 2018, 1 study used the same outcome measure but for different time periods pre-COVID-19 (worst month in last year) and COVID-19 (last month), and 5 studies reported data that were from the same dataset as another study, leaving 36 unique studies that reported data from 33 cohorts for inclusion (Figure 1).30, 32–66

Figure 1.
  • Download figure
  • Open in new tab
Figure 1.

PRISMA 2009 Flow Diagram: Searches through March 22, 2021

Characteristics of Included Studies

Table 1 shows characteristics of included studies. All cohorts reported COVID-19 outcome data collected between March and June 2020. Two large national probability-based cohorts from the United Kingdom30, 34 and the Netherlands36, 37, 41 and a cohort of people with a pre-existing medical condition61 also included data collected between September and November 2020.

View this table:
  • View inline
  • View popup
Table 1.

Characteristics of included studies (N=36)

There were 7 studies30, 32–37 that reported on 5 different general population cohorts, including large national probability-based samples from the United Kingdom (N = 10,918 to 15,376)30, 34 and the Netherlands (N = 3,983 to 4,064)36, 37 and 3 convenience samples with 102 to 218 participants per study from Germany,32 Italy33 and from multiple countries via an online crowdsourcing platform.35

There were 5 studies of older adults, including one (N = 1,679)41 that reported subgroup data from the large Dutch national probability sample.36, 37 There were also large nationally sampled studies from the United Kingdom (N = 3,281),38 Sweden (N = 1,071),39 and China (N = 6,467)42 plus a small study from Scotland (N = 137).40

There were two studies of young adults. One included 2,345 Swiss men (mean age 29 years),43 and the other assessed 3,563 to 3,694 adult twins aged approximately 23 to 26 years.44

Among studies of children and adolescents, one study from China included 1,241 children in grades 4 to 8.48 The other 3 studies, from the Netherlands,45 Spain,46 and Australia,47 included 151 to 248 children or adolescents. The study from the Netherlands also reported results for parents (N = 106).45

There were 10 studies of university students, including 4 from China,49, 53–55 2 from the United States,52, 58 and 1 each from Switzerland,50 Canada,51 India,56 and the United Kingdom;57 all were convenience samples or were not well-described but appeared to be convenience samples. Two studies from China49, 54 analysed data from 2,603 and 4,341 participants, two other studies51, 53 evaluated between 555 and 733 participants, and the other 6 studies50, 52, 55–58 had 217 or fewer participants.

There were 5 studies of people with pre-existing medical conditions. One study from the United States59 included 1,504 participants with rheumatic diseases, and a study from Hong Kong63 evaluated 583 participants. The other 3 studies60–62 all included 435 participants or fewer. Additionally, a study from China assessed 385 physicians in training.64

There were two studies of sexual or gender minority individuals. One was a convenience sample of 2,288 participants with a range of gender identities from the United States,66 and the other was a study of 681 gay or bisexual men from Australia.65

Adequacy of Study Methods and Reporting

Ratings of adequacy of methods and reporting are shown in Table 2. The two large national probability-based cohorts from the United Kingdom30, 34 and the Netherlands36, 37 were rated “Yes” on all items36, 37, 41 or all but one item.30, 34 Another large national study from China42 had access to pre-COVID-19 data from over 188,000 nationally representative older results, but the COVID-19 follow-up (rated “No”) was essentially a convenience sample, as participants (N = 6,467) were recruited via a publicity campaign. There were also concerns about several other studies described as national samples related to sampling or follow-up, some of which were not reported adequately enough to assess.38, 39, 43, 44 Other included studies tended to be local, largely convenience samples.

View this table:
  • View inline
  • View popup
Table 2.

Adequacy of methods and reporting of included studies (N=36)

Overall, among the 36 included studies, there were high proportions of studies with “No” or “Unclear” ratings for appropriate sampling frame (23 studies, 64%), recruitment method (26 studies, 72%), adequate response rate and coverage (30 studies, 83%), and follow-up response rate and management (18 studies, 50%). For participant and setting description, use of valid assessment methods (which was an inclusion requirement for our systematic review), standard outcome collection methods, and providing appropriately analysed results, proportions with “Yes” ratings were between 92% and 100%.

Changes in Mental Health Symptoms

Changes in mental health symptoms are shown in Table 3 for general mental health, Table 4 for anxiety symptoms, and Table 5 for depression symptoms. All meta-analyses included continuous outcomes and data collected between March and June 2020.

View this table:
  • View inline
  • View popup
Table 3.

General Mental Health Outcomes in Included Studies and Subgroups of Included Studiesa

View this table:
  • View inline
  • View popup
Table 4.

Anxiety Symptom Outcomes in Included Studies and Subgroups of Included Studiesa

View this table:
  • View inline
  • View popup
Table 5.

Depression Symptom Outcomes in Included Studies and Subgroups of Included Studiesa

General Mental Health

We were able to synthesize results for 4 general population cohorts (6 studies),30, 33–37 4 cohorts (7 studies) with data for older adults,30, 34, 36, 37, 39–41 and 3 studies of university students.53, 54, 57 In all 3 groups of studies, estimates of change were close to zero, including in the general population (Figure 2a), SMD = 0.02 (95% CI -0.11 to 0.16; N = 19,707; I2 = 94.6%); older adults (Figure 2b), SMD = 0.02 (95% CI -0.11 to 0.16; N = 5,520; I2 = 90.4%); and university students (Figure 2c), SMD = -0.01 (95% CI -0.33 to 0.30; N = 3,372; I2 = 92.0%). The only study that reported statistically significant worse general mental health, a nationally sampled study from the United Kingdom (N = 15,376; SMDdifference = 0.18, 95% CI 0.16 to 0.21; SMDregression = 0.08, 95% CI 0.05 to 010),30 also reported dichotomous data.34 Based on dichotomous data, there was an increase of 8.7% (95% CI 6.9% to 10.4%) of people with a GHQ-12 score of 4 or higher in April 2020 compared to pre-COVID-19, but this dissipated by September 2020 (0.0%, 95% CI -2.0% to 1.9%). Continuous data were only reported in April 2020.

Figures 2a-2c.

Forest plots of standardized mean difference changes in general mental health for studies of the general population (2a), older adults (2b), and university students (2c).

Analyses of data from older adults, young adults, women or females, and men or males from the United Kingdom cohort, based on dichotomous data, suggested some worsening of general mental health in April 2020 with a return to pre-COVID-19 levels by September.30, 34 The general population cohort from the Netherlands, on the other hand, did not identify substantive changes in mental health in either early or late 2020.36, 37

Anxiety Symptoms

Estimates of changes in anxiety symptoms from pre-COVID-19 were close to zero and not statistically significant in 5 studies of university students50, 51, 55, 56, 58 (Figure 3a), SMD = 0.00 (95% CI -0.35 to 0.36; N = 1,537; I2 = 95.4%); 3 studies with data on women or females44, 47, 56 (Figure 3b), SMD = 0.02 (95% CI -0.35 to 0.39; N = 2,778; I2 = 92.3%); and 3 studies with data for men or males44, 47, 56 (Figure 3c), SMD = 0.07 (95% CI -0.01 to 0.15; N = 1,250; I2 = 0.01%). There was a statistically significant increase in anxiety in 3 studies of people with pre-existing medical conditions with outcomes between March and June 202059–61 (Figure 3d), SMD = 0.27 (95% CI 0.01 to 0.54; N = 2,053; I2 = 91.0%). One of the studies also provided anxiety results for October to November 2020;61 when those data were included rather than the earlier data for that study, the difference was smaller but still statistically significant, SMD = 0.19 (95% CI 0.06 to 0.31; N = 1,940; I2 = 52.3%).

Figures 3a-3d.

Forest plots of standardized mean difference changes in anxiety symptoms for studies of university students (3a), women or females (3b), men or males (3c), and people with pre-existing medical conditions (3d).

In other population groups, two large studies of older adults (N = 3,281, N = 6,467)38, 42 and a large study of young adults (N = 3,563)44 reported small but statistically significant increases in anxiety symptoms. Two studies of children or adolescents (N = 248, N = 1,241)47, 48 did not find statistically significant differences from zero. Among studies of sexual or gender minority individuals, a study of 681 gay or bisexual men reported a change estimate close to zero,65 whereas a study of 2,288 people with multiple gender identities reported a large increase (SMD = 0.54, 95% CI 0.48 to 0.60).66

Depression Symptoms

Changes in depression symptoms were close to zero or small and not statistically significant in 4 meta-analyses, including 5 studies of university students50, 51, 55, 56, 58 (Figure 4a), SMD = 0.19 (95% CI -0.08 to 0.45; N = 1,537; I2 = 91.8%); 3 studies of people with pre-existing medical conditions59–61 (Figure 4b), SMD = 0.01 (95% CI -0.06 to 0.08; N = 2,006; I2 = 14.9%), 3 studies on women or females44, 47, 56 (Figure 4c), SMD = 0.21 (95% CI -0.14 to 0.55; N = 2,843; I2 = 91.2%); and 4 studies with men or males43, 44, 47, 56 (Figure 4d), SMD = 0.00 (95% CI -0.21 to 0.22; N = 3,661; I2 = 92.3%). Results were similar for people with pre-existing medical conditions when data from October to November 2020 were used instead of data from earlier for one study61 (not shown).

Figures 4a-4d.

Forest plots of standardized mean difference changes in depression symptoms for studies of university students (4a), people with pre-existing medical conditions (4b), women or females (4c), and men or males (4d).

In other groups, individual studies reported small statistically significant increases among older adults (N = 3,281),38 children and adolescents (N = 248, N = 1,241),47, 48 and sexual or gender minority individiuals.66 One study (N = 2,345)43 reported a statistically significant, small, improvement among young adult men, and studies reported non-statistically significant findings in the general population (N = 102, N = 218),32, 35 among young adults (N = 3,563),44 and in a sample of gay and bisexual men (N = 681).65

DISCUSSION

Principal Findings

We reviewed over 45,000 citations and included 36 studies from 33 cohorts that compared general mental health, anxiety symptoms, or depression symptoms during COVID-19 to assessments done prior to COVID-19. Included studies assessed mental health changes in the general population and among older adults, younger adults, children and adolescents, parents, university students, people with pre-existing medical conditions, medical staff, and sexual or gender minority individuals. All studies assessed COVID-19 symptoms between March and June 2020. Large population-based cohorts from the United Kingdom30, 34 and the Netherlands36, 37, 41 and a cohort of people with the rare autoimmune disease systemic sclerosis from 4 countries61 also assessed symptoms between September and November 2020.

The main finding was that there was little evidence that mental health symptoms have worsened on a population level during COVID-19. Among general population studies, there was no change in general mental health (SMD = 0.02, 95% CI -0.11 to 0.16; 4 studies, N = 19,707), and changes in anxiety and depression symptoms, which were reported in only two small studies,32, 35 did not differ significantly from zero. Similarly, meta-analyses of general mental health in older adults (4 studies, N = 5,520) and university students (3 studies, N = 3,372); anxiety symptoms in university students (5 studies, N = 1,537), women or females (3 studies, N = 2,778), and men or males (3 studies, N = 1,250); and depression symptoms in university students (5 studies, N = 1,537); people with pre-existing medical conditions (3 studies, N = 2,006), women or females (3 studies, N = 2,843), and men or males (3 studies, N = 3,661) did not find that changes in mental health symptoms during COVID-19 differed substantively or statistically significantly from pre-COVID-19 levels.

There were exceptions. Among people with pre-existing medical conditions, symptoms of anxiety increased in March to June 2020 compared to pre-COVID-19 (SMD = 0.27, 95% CI 0.01 to 0.54; 3 studies, N = 2,053). Additionally, among groups where meta-analyses were not conducted, in one study of 2,288 gender-minority individuals, symptoms of anxiety increased by SMD = 0.54 (95% CI 0.48 to 0.60),66 although another study of 681 gay and bisexual men did not find a difference (SMD = 0.08, 95% CI -0.02 to 0.19).65

There were 3 cohorts30, 34, 36, 37, 41, 61 that assessed changes in both March to June and September to November 2020. In a large Dutch general population sample (N = 3,983 to 4,064), change in general mental health was close to zero at both time points, and this was also the case for subgroups.36, 37, 41 In a United Kingdom general population study, there was a small worsening from pre-COVID-19 to April 2020 based on continuous30 and dichotomous34 results, but dichotomous results from September 2020 were not different from pre-COVID-19. Similarly, in a cohort of people with systemic sclerosis,61 anxiety symptoms were substantially higher in April 2020 compared to pre-COVID-19 (N = 435; SMD = 0.51, 95% CI 0.37 to 0.64), but they were closer to pre-COVID-19 levels in October to November 2020 (N = 322; SMD = 0.16, 95% CI 0.01 to 0.32).

Findings in Context

The main finding that mental health does not appear to have worsened substantively in COVID-19 is consistent with analyses from other studies of mental health disorders and suicide. A study from Norway67 evaluated current mental disorders using the Composite International Diagnostic Interview (version 5.0) in a series of cross-sectional random samples accumulated from January 28 to March 11, 2020 (N = 563, 15.4%, 95% CI 12.5% to 18.8%), March 12 to May 31, 2020 (N = 691, 9.0%, 95% CI 7.1% to 11.4%), June 1 to July 31, 2020 (N = 530, 14.3%, 95% CI 11.5% to 17.5%), and August 1 to September 18, 2020 (N = 370, 11.9%, 95% CI 9.0% to 15.6%). The authors concluded that prevalence during COVID-19, compared to January to March 2020, which they considered pre-COVID-19, was stable or slightly decreased.

The authors of the largest study to date on suicide in COVID-1968 analysed data from official government sources on suicide occurences at a monthly level from January 1, 2019 or earlier to July 31, 2020. They used an interrupted time-series analysis to model trends in monthly suicides before COVID-19 (January 1, 2019 or earlier to March 31, 2020) and compared the expected number from the model with the observed number of suicides from April 1 to July 31, 2020 for data from 21 countries. There was no evidence of a statistically significant increase in suicide risk in any country or area; there were, however, statistically significant decreases in 12 countries or areas.

Together, our findings on mental health symptoms, along with evidence on mental disorders and suicide, converge to suggest that COVID-19 mental health may be, at least up to now, a story of resilience rather than a mental health disaster, pandemic unto itself, or “tsunami” as has been described widely in the media.19 Short news cycles that emphasize dramatic events, anecdotes, and an uncritical reliance on unvalidated, difficult to interpret survey tools that inquire about mental health and well-being in COVID-19 among conveniently recruited volunteers might at least partially explain this discrepancy. Illustrating the pitfalls of interpreting studies that ask about COVID-19-specific angst, a study of 2,345 young men from Switzerland43 evaluated depression symptoms and stress during COVID-19 and found that they had significantly decreased compared to pre-pandemic levels. They also reported results from a series of unvalidated single items that queried about psychological status during COVID-19 and specifically assigned COVID-19 as the cause (e.g., “due to COVID-19, I experienced…”); these items suggested very high levels of distress, which became the focus of the study’s conclusions. Together with the findings from our systematic review, this suggests that many or most people are likely experiencing different aspects of COVID-19 as highly unpleasant or distressing, but that most people have been resilient and that there is no evidence that population-level mental health has changed substantively.

Policy Implications

The lack of a decline in mental health so far in COVID-19 could be because people are resilient and have made the best of a difficult situation. Indeed, although evidence is thin in this area, there are data to suggest, for instance, that suicide has generally declined during periods of societal conflict.69–73 War and pandemics have very different characteristics, but in both there is a shared threat and common focus on collective action to address that threat.

The absence of evidence of substantive mental health decline could also reflect steps that governments around the world have taken to support mental health. The World Health Organization, other pan-national organizations, and governments across the globe have produced strategies for addressing mental health and have invested in resources to support public mental health,74, 75 even in countries where mental health had not been a priority previously.76, 77 It is not known to what degree these efforts have been effective, but it is possible that government action has played an important role.

Strengths and Limitations

Strengths of our systematic review include using rigorous best-practice methods; searching 9 databases, including 2 Chinese databases; not restricting inclusion by language; and the ability to update rapidly as evidence emerges via our living systematic review approach. There are also limitations that suggest some level of caution in interpreting results. First, aside from several population-level randomly sampled surveys, most of the studies included in our systematic review had limitations related to study sampling frames and recruitment methods, response and follow-up rates, and management of missing follow-up data. Second, heterogeneity was high in most of the meta-analyses that we conducted. Third, only a handful of studies reported results from the fall months of 2020, and, although the few studies that did suggested that symptoms were stable or reduced from earlier in the pandemic, more data are needed. Fourth, although we were able to synthesize results from several vulnerable groups, including older adults and people with pre-existing medical conditions, there were few studies with results for other vulnerable groups. It is possible that some groups may be experiencing important negative mental health effects of the pandemic and were not included in the studies we identified. Fifth, some potentially important outcomes, such as loneliness, were infrequently studied and not included in the present report. Sixth, the evidence base is rapidly evolving, and main results could change, although our living systematic review format will allow rapid updating as this occurs.

Conclusions

We reviewed 36 studies with data from 33 unique cohorts. Across population groups, results suggest that, rather than a mental health crisis, at a population level, there has been a high level of resilience during COVID-19 with minimal change in general mental health, anxiety symptoms, and depressive symptoms. There were few robust studies with vulnerable groups, however, and it is possible that there are population groups that are experiencing a different level of mental health effect than the general population or other groups. COVID-19 continues to affect societies across the world, and it will be important to continue to assess mental health as lockdown restrictions continue, even intermittently, and post-COVID-19, as COVID-19 mental health implications may persist beyond the pandemic. There do not appear to be substantial negative population-wide mental health effects at this point, but the pandemic has upended the lives of many people around the world, and there is little doubt that some people who have not experienced mental health difficulties previously are experiencing them now. Governments should continue to ensure that mental health supports are maximally available.

Data Availability

All data used in the study are available in the manuscript and its tables or on online at https://www.depressd.ca/covid-19-mental-health.

https://www.depressd.ca/covid-19-mental-health.

Contributions

YS, YWu, DBR, AB, and BDT were responsible for the study conception and design. JTB was responsible for the design of the database searches. AK carried out the searches. YS, YWu, OB, AK, CH, YWang, DBR, XJ, KL, SM, MA, ITV, DN, TDS, AT, AY, and BDT contributed to data extraction, coding, and evaluation of included studies. OB, CH, and YS were responsible for study coordination. YS, YWu, BL, AB, and BDT were involved in data analysis. BA, CF, MSM, SS, and GT contributed to interpretation of results as knowledge translation partners. YS and BDT drafted the manuscript. All authors provided a critical review and approved the final manuscript. BDT is the guarantor; he had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analyses. BDT is the corresponding author and attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

Copyright for Authors

The Corresponding Author has the right to grant on behalf of all authors and does grant on behalf of all authors, a worldwide licence to the Publishers and its licensees in perpetuity, in all forms, formats and media (whether known now or created in the future), to i) publish, reproduce, distribute, display and store the Contribution, ii) translate the Contribution into other languages, create adaptations, reprints, include within collections and create summaries, extracts and/or, abstracts of the Contribution, iii) create any other derivative work(s) based on the Contribution, iv) to exploit all subsidiary rights in the Contribution, v) the inclusion of electronic links from the Contribution to third party material where-ever it may be located; and, vi) licence any third party to do any or all of the above.

The Corresponding Author has the right to grant on behalf of all authors and does grant on behalf of all authors, an exclusive licence (or non-exclusive for government employees) on a worldwide basis to the BMJ Publishing Group Ltd to permit this article (if accepted) to be published in BMJ editions and any other BMJPGL products and sublicences such use and exploit all subsidiary rights, as set out in our licence.

Funding

The study was funded by the Canadian Institutes of Health Research (CMS-171703; MS1-173070) and McGill Interdisciplinary Initiative in Infection and Immunity Emergency COVID-19 Research Fund (R2-42). YWu and BL were supported by a Fonds de recherche du Québec – Santé (FRQS) Postdoctoral Training Fellowship. DBR was supported by a Vanier Canada Graduate Scholarship. AB was supported by FRQS senior researcher salary awards. BDT was supported by a Tier 1 Canada Research Chair.

Declaration of Competing Interests

All authors have completed the ICJME uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years. All authors declare no relationships or activities that could appear to have influenced the submitted work. No funder had any role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. BDT and AB declared that they were authors of an included study.61

Ethical Approval

As this study was a systematic review of published results, it did not require ethical approval.

Transparency Declaration

The manuscript’s guarantor affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

Data Sharing

All data used in the study are available in the manuscript and its tables or on online at https://www.depressd.ca/covid-19-mental-health.

Dissemination to study participants or patient communities

There are no plans to disseminate the results of the research directly to a relevant patient community. However, all study results are available at https://www.depressd.ca/research-question-1-symptom-changes.

Provenance and peer review

Not commissioned; externally peer reviewed.

CC BY licence

The default licence, a CC BY NC licence, is needed.

What is already known on this topic

  • Large numbers of studies and media reports have concluded that COVID-19 has led to widespread decline in population mental health.

  • Existing evidence reviews have been based on cross-sectional studies and conclusions based on proportions of study respondents above thresholds on mental health measures, which are not intended for this purpose and can be highly misleading.

What this study adds

  • We synthesized evidence from 36 studies that compared general mental health, anxiety symptoms, or depression symptoms during COVID-19 to outcomes prior to COVID-19 in the same participant cohort.

  • Mental health in the general population has not worsened compared to pre-COVID-19 levels.

  • Among other populations, anxiety among people with pre-existing medical conditions appears to have increased early in the pandemic, although it may have improved in later months; there were no indications of negative changes in other populations for any other outcomes.

Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab
Figure
  • Download figure
  • Open in new tab

REFERENCES

  1. 1.↵
    World Health Organization. WHO Coronavirus Disease (COVID-19) Dashboard. https://covid19.who.int/. Accessed May 10, 2021.
  2. 2.↵
    World Health Organization. Impact of COVID-19 on people’s livelihoods, their health and our food systems: joint statement by ILO, FAO, IFAD and WHO. https://www.who.int/news/item/13-10-2020-impact-of-covid-19-on-people%27s-livelihoods-their-health-and-our-food-systems. Accessed May 10, 2021.
  3. 3.↵
    Rubin GJ, Wessely S. The psychological effects of quarantining a city. BMJ 2020;368:m313.
    OpenUrlFREE Full Text
  4. 4.↵
    Living systematic review of mental health in COVID-19. https://www.depressd.ca/covid-19-mental-health. Accessed May 10, 2021.
  5. 5.↵
    Glasziou P, Sanders S, Hoffmann T. Waste in covid-19 research. BMJ 2020;369:m1847
    OpenUrlFREE Full Text
  6. 6.↵
    Thombs BD, Kwakkenbos L, Levis AW, et al. Addressing overestimation of the prevalence of depression based on self-report screening questionnaires. CMAJ 2018;190:E44–E49.
    OpenUrlFREE Full Text
  7. 7.
    Levis B, Yan XW, He C, et al. Comparison of depression prevalence estimates in meta-analyses based on screening tools and rating scales versus diagnostic interviews: a meta-research review. BMC Med 2019;17:65.
    OpenUrlPubMed
  8. 8.
    Levis B, Benedetti A, Ioannidis JPA, et al. Patient Health Questionnaire-9 scores do not accurately estimate depression prevalence: individual participant data meta-analysis. J Clin Epidemiol 2020;122:115–128.
    OpenUrlPubMed
  9. 9.
    Lyubenova A, Neupane D, Levis B, et al. Depression prevalence based on the Edinburgh Postnatal Depression Scale compared to Structured Clinical Interview for DSM Disorders classification: Systematic review and individual participant data meta-analysis. Int J Methods Psychiatr Res 2021;30:e1860.
    OpenUrl
  10. 10.↵
    Brehaut E, Neupane D, Levis B, et al. Depression prevalence using the HADS-D compared to SCID major depression classification: An individual participant data meta-analysis. J Psychosom Res 2020;139:110256.
    OpenUrl
  11. 11.↵
    Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606–613.
    OpenUrlCrossRefPubMedWeb of Science
  12. 12.↵
    Yu X, Tam WWS, Wong PTK, et al. The Patient Health Questionnaire-9 for measuring depressive symptoms among the general population in Hong Kong. Compr Psychiatry 2012;53:95–102.
    OpenUrlCrossRefPubMedWeb of Science
  13. 13.↵
    Kocalevent RD, Hinz A, Brähler E. Standardization of the depression screener Patient Health Questionnaire (PHQ-9) in the general population. Gen Hosp Psychiatry 2013;35:551–555.
    OpenUrlCrossRefPubMedWeb of Science
  14. 14.↵
    Wang W, Bian Q, Zhao Y, et al. Reliability and validity of the Chinese version of the Patient Health Questionnaire (PHQ-9) in the general population. Gen Hosp Psychiatry 2014;36:539–544.
    OpenUrlCrossRefPubMed
  15. 15.↵
    Cao C, Hu L, Xu T, et al. Prevalence, correlates, and misperception of depression symptoms in the United States, NHANES 2015-2018. J Affect Disord 2020;269:51-57.
    OpenUrl
  16. 16.↵
    Patten SB, Schopflocher D. Longitudinal epidemiology of major depression as assessed by the Brief Patient Health Questionnaire (PHQ-9). Compr Psychiatry 2009;50:26–33.
    OpenUrlPubMed
  17. 17.↵
    Johansson R, Carlbring P, Heedman A, et al. Depression, anxiety and their comorbidity in the Swedish general population: point prevalence and the effect on health-related quality of life. PeerJ 2013;1:e98.
    OpenUrl
  18. 18.↵
    Lu S, Reavley N, Zhou J, et al. Depression among the general adult population in Jiangsu Province of China: prevalence, associated factors and impacts. Soc Psychiatry Psychiatr Epidemiol 2018;53:1051–1061.
    OpenUrl
  19. 19.↵
    Bentall R. Has the pandemic really caused a ‘tsunami’ of mental health problems? The Guardian. February 9, 2021. https://www.theguardian.com/commentisfree/2021/feb/09/pandemic-mental-health-problems-research-coronavirus. Accessed May 10, 2021.
  20. 20.↵
    Elliott JH, Synnot A, Turner T, et al. Living systematic review: 1. Introduction – the why, what, when, and how. J Clin Epidemiol 2017;91:23–30.
    OpenUrlCrossRefPubMed
  21. 21.↵
    Thombs BD, Bonardi O, Rice DB, et al. Curating evidence on mental health during COVID-19: a living systematic review. J Psychosom Res 2020;133;110113.
    OpenUrl
  22. 22.↵
    Thombs BD, Bonardi O, Rice DB, et al. Mental health during the COVID-19 pandemic: protocol for a living systematic review of symptom levels, factors associated with symptoms, and intervention effectiveness. OSF 2020. Available from https://osf.io/96csg/.
  23. 23.↵
    Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71.
    OpenUrlFREE Full Text
  24. 24.↵
    World Health Organization. Rolling updates on coronavirus disease (COVID-19) 2020. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/events-as-they-happen. Accessed May 10, 2021.
  25. 25.↵
    Joanna Briggs Institute. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews: Checklist for Prevalence Studies. https://jbi.global/critical-appraisal-tools. Accessed May 10, 2021.
  26. 26.↵
    Hedges LV. Estimation of effect size from a series of independent experiments. Psychol Bull 1982;92:490–499.
    OpenUrlCrossRefPubMedWeb of Science
  27. 27.↵
    Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Chapter 4: Effect sizes based on means. In Borenstein M, Hedges LV, Higgins JPT, Rothstein HR (editors). Introduction to meta-analysis. Wiley & Sons: West Sussex, UK. 2009.
  28. 28.↵
    Agresti A, Coull BA. Approximate is better than “exact” for interval estimation of binomial proportions. Am Stat 1998;52:119–26.
    OpenUrlCrossRefWeb of Science
  29. 29.↵
    Newcombe RG. Improved confidence intervals for the difference between binomial proportions based on paired data. Stat Med 1998;17:2635–2650.
    OpenUrlCrossRefPubMedWeb of Science
  30. 30.↵
    Pierce M, Hope H, Ford T, et al. Mental health before and during the COVID-19 pandemic: a longitudinal probability sample survey of the UK population. Lancet Psychiatry 2020;7:883–92.
    OpenUrlPubMed
  31. 31.↵
    Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw 2010;36:1–48.
    OpenUrlCrossRefPubMed
  32. 32.↵
    Benz A, Meier M, Bentele UU, et al. Early life adversity, dispositional mindfulness, and longitudinal stress experience during the COVID-19 pandemic. PsyArXiv 2020. https://doi.org/10.31234/osf.io/5kt6z.
  33. 33.↵
    Castellini G, Rossi E, Cassioli E, et al. A longitudinal observation of general psychopathology before the COVID-19 outbreak and during lockdown in Italy. J Psychosom Res 2021;141:110328.
    OpenUrl
  34. 34.↵
    Daly M, Robinson E. Longitudinal changes in psychological distress in the UK from 2019 to September 2020 during the COVID-19 pandemic: Evidence from a large nationally representative study. Psychiatry Res 2021;300:113920.
    OpenUrl
  35. 35.↵
    Katz B, Yovel I. Mood Symptoms Predict COVID-19 Pandemic Distress but not vice versa: An 18-Month Longitudinal Study. PsyArXiv 2020. https://doi.org/10.31234/osf.io/6qske.
  36. 36.↵
    van der Velden PG, Contino C, Das M, van Loon P, Bosmans MW. Anxiety and depression symptoms, and lack of emotional support among the general population before and during the COVID-19 pandemic. A prospective national study on prevalence and risk factors. J Affect Disord 2020;277:540–8.
    OpenUrlPubMed
  37. 37.↵
    van der Velden PG, Marchand M, Das M, Muffels R, Bosmans M. The prevalence, incidence and risk factors of mental health problems and mental health services use before and 9 months after the COVID-19 outbreak among the general Dutch population. A 3-wave prospective study. MedRxiv 2021. https://doi.org/10.1101/2021.02.27.21251952.
  38. 38.↵
    Creese B, Khan Z, Henley W, et al. Loneliness, physical activity and mental health during Covid-19: a longitudinal analysis of depression and anxiety between 2015 and 2020. Int Psychogeriatr 2020. https://doi.org/10.1017/S1041610220004135.
  39. 39.↵
    Kivi M, Hansson I, Bjälkebring P. Up and about: Older adults’ well-being during the COVID-19 pandemic in a Swedish longitudinal study. J Gerontol 2021;76:e4–9.
    OpenUrl
  40. 40.↵
    Okely JA, Corley J, Welstead M, et al. Change in Physical Activity, Sleep Quality, and Psychosocial Variables during COVID-19 Lockdown: Evidence from the Lothian Birth Cohort 1936. Int J Environ Res Public Health 2021;18:210.
    OpenUrl
  41. 41.↵
    Van Tilburg TG, Steinmetz S, Stolte E, van der Roest H, de Vries DH. Loneliness and mental health during the COVID-19 pandemic: A study among Dutch older adults. J Gerontol 2020. https://doi.org/10.1093/geronb/gbaa111.
  42. 42.↵
    Wang ZH, Qi SG, Zhang H. 新型冠状病毒肺炎对社区老年人焦虑症状的影响 [Impact of the COVID 19 epidemic on anxiety among the elderly in community] Natl Med J China 2020;100:3179-85.
    OpenUrl
  43. 43.↵
    Marmet S, Wicki M, Gmel G, et al. The psychological impact of the COVID-19 crisis on young Swiss men participating in a cohort study. PsyArXiv 2020. Preprint. https://doi.org/10.31234/osf.io/kwxhd.
  44. 44.↵
    Rimfeld K, Malanchini M, Allegrini AG, et al. Genetic correlates of psychological responses to the COVID-19 crisis in young adult twins in Great Britain. Behav Genet 2021;51:110–24.
    OpenUrl
  45. 45.↵
    Achterberg M, Dobbelaar S, Boer OD, Crone E. Perceived stress as mediator for longitudinal effects of the COVID-19 lockdown on wellbeing of parents and children. Sci Rep 2021;11:2971.
    OpenUrl
  46. 46.↵
    Ezpeleta L, Navarro JB, de la Osa N, Trepat E, Penelo E. Life conditions during COVID-19 lockdown and mental health in Spanish adolescents. Int J Environ Res Public Health 2020;17:7327.
    OpenUrlCrossRefPubMed
  47. 47.↵
    Magson NR, Freeman JY, Rapee RM, Richardson CE, Oar EL, Fardouly J. Risk and protective factors for prospective changes in adolescent mental health during the COVID-19 pandemic. J Youth Adolesc 2021;50:44–57.
    OpenUrl
  48. 48.↵
    Zhang L, Zhang D, Fang J, Wan Y, Tao F, Sun Y. Assessment of mental health of Chinese primary school students before and after school closing and opening during the COVID-19 pandemic. JAMA Netw Open 2020;3:e2021482.
    OpenUrl
  49. 49.↵
    Dong XL. 新型冠状病毒肺炎疫情对师范类大学生心理健康的影响研究 [Influence study of COVID-2019 on mental health of normal college students] PSY 2020. https://www.doi.org/10.19738/j.cnki.psy.2020.20.013.
  50. 50.↵
    Elmer T, Mepham E, Stadtfeld C. Students under lockdown: Comparison of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland. PLoS ONE 2020;15:e0236337.
    OpenUrlCrossRef
  51. 51.↵
    Hamza CA, Ewing L, Heath NL, Goldstein AL. When social isolation is nothing new: A longitudinal study psychological distress during COVID-19 among university students with and without preexisting mental health concerns. Can Psychol 2021;62:20–30.
    OpenUrl
  52. 52.↵
    Huckins J, da Silva A, Wang W, et al. Mental health and behaviour of college students during the early phases of the COVID-19 pandemic: longitudinal smartphone and ecological momentary assessment study. J Med Internet Res 2020;22:e20185.
    OpenUrlCrossRef
  53. 53.↵
    Li HY, Cao H, Leung DY, Mak YW. The psychological impacts of a COVID-19 outbreak on college students in China: a longitudinal study. Int J Environ Res Public Health 2020;17:3933.
    OpenUrlCrossRefPubMed
  54. 54.↵
    Li RL, Dai J, Yuan XY, Li L. 新冠肺炎疫情期大学生心理健康状况 [Mental health of college students during COVID-19] J Panzhihua University 2020;37:18–24
    OpenUrl
  55. 55.↵
    Li WW, Yu H, Miller DJ, Yang F, Rouen C. Novelty seeking and mental health in Chinese university students before, during, and after the COVID-19 pandemic lockdown: a longitudinal study. Front Psychol 2020. https://doi.org/10.3389/fpsyg.2020.600739.
  56. 56.↵
    Saraswathi I, Saikarthik J, Kumar KS, Srinivasan KM, Ardhanaari M, Gunapriya R. Impact of COVID-19 outbreak on the mental health status of undergraduate medical students in a COVID-19 treating medical college: a prospective longitudinal study. PeerJ 2020;8:e10164.
    OpenUrl
  57. 57.↵
    Savage MJ, James R, Magistro D, et al. Mental health and movement behaviour during the COVID-19 pandemic in UK university students: Prospective cohort study. Ment Health Phys Act 2020;19:100357.
    OpenUrl
  58. 58.↵
    Zimmermann M, Bledsoe C, Papa A. The impact of the COVID-19 pandemic on college student mental health: A longitudinal examination of risk and protective factors. PsyArXiv 2020. https://doi.org/10.31234/osf.io/2y7hu.
  59. 59.↵
    Katz P, Pedro S, Wipfler K, et al. Changes in Mental Health During the COVID-19 Pandemic Among Individuals with Rheumatic Disease. Arthritis Rheumatol 2020;72 (suppl 10). https://acrabstracts.org/abstract/changes-in-mental-healthduring-the-covid-19-pandemic-among-individuals-with-rheumatic-disease/.
  60. 60.↵
    Liang JQ, Li XQ, Zhang WL, et al. 新冠肺炎流行期住院集中医学观察期间血液透析患者的焦虑抑郁状况 [Anxiety and depression in patients with maintenance hemodialysis under concentrated medical observation in hospital during the COVID-19 epidemic] Chinese Mental Health Journal 2020. https://www.doi.org/10.3969/j.isn.10-6729.2020.12.014.
  61. 61.↵
    Thombs BD, Kwakkenbos L, Henry RS, et al. Comparison of mental health symptoms prior to and during COVID-19 among patients with systemic sclerosis from four countries: a Scleroderma Patient-centered Intervention Network (SPIN) Cohort study. J Psychosom Res 2020;139:110262.
    OpenUrl
  62. 62.↵
    Ubara A, Sumi Y, Ito K, et al. Self-isolation due to CoViD-19 is linked to small one-year changes in depression, sleepiness, and insomnia: results from a clinic for sleep disorders in Shiga Prefecture, Japan. Int J Environ Res Public Health 2020;17:8971.
    OpenUrl
  63. 63.↵
    Wong SY, Zhang D, Sit RW, et al. Impact of COVID-19 on loneliness, mental health, and health service utilisation: a prospective cohort study of older adults with multimorbidity in primary care. Br J Gen Pract 2020;70:e817–24.
    OpenUrlAbstract/FREE Full Text
  64. 64.↵
    Li W, Frank E, Zhao Z, et al. Mental health of young physicians in China during the novel coronavirus disease 2019 outbreak. JAMA Netw Open 2020;3:e2010705.
    OpenUrl
  65. 65.↵
    Bavinton BR, Hammoud MA, Chan C, et al. Depression and Anxiety in Australian Gay and Bisexual Men Prior to and During Covid-19 Restrictions. Sexual Health 2020;17:XVIII.
    OpenUrl
  66. 66.↵
    Flentje A, Obedin-Maliver J, Lubensky ME, Dastur Z, Neilands T, Lunn MR. Depression and anxiety changes among sexual and gender minority people coinciding with onset of COVID-19 pandemic. J Gen Intern Med 2020;35:2788–90.
    OpenUrlPubMed
  67. 67.↵
    Knudsen AK, Stene-Larsen K, Gustavson K, et al. Prevalence of mental disorders, suicidal ideation and suicides in the general population before and during the COVID-19 pandemic in Norway: A population-based repeated cross-sectional analysis. Lancet Reg Health 2021;4:100071.
    OpenUrl
  68. 68.↵
    Pirkis J, John A, Shin S, et al. Suicide trends in the early months of the COVID-19 pandemic: an interrupted time-series analysis of preliminary data from 21 countries. Lancet Psychiatry 2021. https://doi.org/10.1016/S2215-0366(21)00091-2.
  69. 69.↵
    Lester D. The effect of war on suicide rates. A study of France from 1826 to 1913. Euro Arch Psychiatry Clin Neurosci 1993;242:248-9.
    OpenUrlCrossRefPubMedWeb of Science
  70. 70.
    Lester D. Suicide rates before, during and after the world wars. Eur Psychiatry 19949:262–264.
  71. 71.
    Somasundaraam DJ, Rajadurai S: War and suicide in northern Sri Lanka. Acta Psychiatr Scand 1995;91:1–4.
    OpenUrlCrossRefPubMedWeb of Science
  72. 72.
    Aida T. Revisiting suicide rate during wartime: Evidence from the Sri Lankan civil war. PLoS One 2020;15:e0240487.
    OpenUrl
  73. 73.↵
    Marshall JR. Political integration and the role of war in suicide. Soc Forces 1981;59:771–785.
    OpenUrlCrossRefWeb of Science
  74. 74.↵
    McMartan C, Adell T, Cameron J, et al. A scoping review of international policy responses to mental health recovery during the COVID-19 pandemic. Health Res Policy Syst 2021;19:58.
    OpenUrl
  75. 75.↵
    Arendt F, Markiewitz A, Mestas M, Scherr S. COVID-19 pandemic, government responses, and public mental health: Investigating consequences through crisis hotline calls in two countries. Soc Sci Med 2020;265:113532.
    OpenUrl
  76. 76.↵
    Ju Y, Zhang Y, Wang X, Li W, Ng RMK, Li L. China’s mental health support in response to COVID-19: progression, challenges and reflection. Global Health 2020;16:102.
    OpenUrl
  77. 77.↵
    Wang V, Hernández JC. China long avoided discussing mental health. The pandemic changed that. New York Times. December 21, 2020. https://www.nytimes.com/2020/12/21/world/asia/china-covid-mental-health.html. Accessed May 10, 2021.
Back to top
PreviousNext
Posted May 11, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Comparison of Mental Health Symptoms prior to and during COVID-19: Evidence from a Living Systematic Review and Meta-analysis
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Comparison of Mental Health Symptoms prior to and during COVID-19: Evidence from a Living Systematic Review and Meta-analysis
Ying Sun, Yin Wu, Olivia Bonardi, Ankur Krishnan, Chen He, Jill T. Boruff, Danielle B. Rice, Yutong Wang, Xiaowen Jiang, Kexin Li, Sarah Markham, Brooke Levis, Marleine Azar, Ian Thombs-Vite, Dipika Neupane, Tiffany Dal Santo, Amina Tasleem, Anneke Yao, Branka Agic, Christine Fahim, Michael S. Martin, Sanjeev Sockalingam, Gustavo Turecki, Andrea Benedetti, Brett D. Thombs
medRxiv 2021.05.10.21256920; doi: https://doi.org/10.1101/2021.05.10.21256920
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Comparison of Mental Health Symptoms prior to and during COVID-19: Evidence from a Living Systematic Review and Meta-analysis
Ying Sun, Yin Wu, Olivia Bonardi, Ankur Krishnan, Chen He, Jill T. Boruff, Danielle B. Rice, Yutong Wang, Xiaowen Jiang, Kexin Li, Sarah Markham, Brooke Levis, Marleine Azar, Ian Thombs-Vite, Dipika Neupane, Tiffany Dal Santo, Amina Tasleem, Anneke Yao, Branka Agic, Christine Fahim, Michael S. Martin, Sanjeev Sockalingam, Gustavo Turecki, Andrea Benedetti, Brett D. Thombs
medRxiv 2021.05.10.21256920; doi: https://doi.org/10.1101/2021.05.10.21256920

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Psychiatry and Clinical Psychology
Subject Areas
All Articles
  • Addiction Medicine (174)
  • Allergy and Immunology (420)
  • Anesthesia (97)
  • Cardiovascular Medicine (896)
  • Dentistry and Oral Medicine (169)
  • Dermatology (102)
  • Emergency Medicine (257)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (405)
  • Epidemiology (8764)
  • Forensic Medicine (4)
  • Gastroenterology (404)
  • Genetic and Genomic Medicine (1857)
  • Geriatric Medicine (177)
  • Health Economics (387)
  • Health Informatics (1284)
  • Health Policy (642)
  • Health Systems and Quality Improvement (490)
  • Hematology (206)
  • HIV/AIDS (392)
  • Infectious Diseases (except HIV/AIDS) (10543)
  • Intensive Care and Critical Care Medicine (564)
  • Medical Education (193)
  • Medical Ethics (52)
  • Nephrology (218)
  • Neurology (1748)
  • Nursing (102)
  • Nutrition (265)
  • Obstetrics and Gynecology (342)
  • Occupational and Environmental Health (459)
  • Oncology (962)
  • Ophthalmology (281)
  • Orthopedics (107)
  • Otolaryngology (176)
  • Pain Medicine (117)
  • Palliative Medicine (41)
  • Pathology (263)
  • Pediatrics (556)
  • Pharmacology and Therapeutics (264)
  • Primary Care Research (218)
  • Psychiatry and Clinical Psychology (1841)
  • Public and Global Health (3975)
  • Radiology and Imaging (650)
  • Rehabilitation Medicine and Physical Therapy (341)
  • Respiratory Medicine (534)
  • Rheumatology (215)
  • Sexual and Reproductive Health (178)
  • Sports Medicine (166)
  • Surgery (196)
  • Toxicology (37)
  • Transplantation (106)
  • Urology (79)