Abstract
Our goal is to inform ongoing public health policy on the design and communication of COVID-19 social distancing measures to maximize compliance. We assessed the US public’s early experience with the COVID-19 crisis during the period when shelter-in-place orders were widely implemented to understand non-compliance with those orders, sentiment about the crisis, and to compare across age categories associated with different levels of risk. We posted our survey on Twitter, Facebook, and NextDoor on March 14th to March 23rd that included 21 questions including demographics, impact on daily life, actions taken, and difficulties faced.1 We analyzed the free-text responses to the impact question using LIWC, a computational natural language processing tool2, and performed a thematic content analysis of the reasons people gave for non-compliance with social distancing orders. Stanford University’s IRB approved the study.
In 9 days, we collected a total of 20,734 responses. 6,573 individuals provided a response (≥30 words) to the question, “Tell us how the coronavirus crisis is impacting your life.” Our data (Figure 1) show that younger people (18-31) are more emotionally negative, self-centered, and less concerned with family, while middle-aged people are group-oriented (32-44) and focused on family (32-64) (all p values < .05 corrected for multiple comparisons). Unsurprisingly, the oldest and most at-risk group (65+) are more focused on biological terms (e.g., health-related topics), but were surprisingly low in anxiety and high in emotionally positive terms relative to those at lower risk.
We also content-analyzed 7,355 responses (kappa’s > .75) to the question, “What are the reasons you are not self-isolating more?” Of these participants, 39.8% reported not being compliant, with the youngest group (18-31) having the lowest compliance rate (52.4%) compared to the other age groups (all > 60%; all p values < .01). Table 1 describes the seven primary themes for non-compliance. Non-essential work requirements, concerns about mental and physical health, and the belief that other precautions were sufficient were the most common reasons, although other rationales included wanting to continue everyday activities and beliefs that society is over-reacting. Childcare was an important concern for a subset of respondents.
Overall, our findings suggest that public health messages should focus on young people and 1) address their negative affect, 2) refocus their self-orientation by emphasizing the importance of individual behavior to group-level health outcomes, and 3) target the specific rationales that different people have regarding the pandemic to maximize compliance with social distancing.
Our goal is to inform ongoing public health policy on the design and communication of COVID-19 social distancing measures to maximize compliance. We assessed the US public’s early experience with the COVID-19 crisis during the period when shelter-in-place orders were widely implemented to understand non-compliance with those orders, sentiment about the crisis, and to compare across age categories associated with different levels of risk. We posted our survey on Twitter, Facebook, and NextDoor on March 14th to March 23rd that included 21 questions including demographics, impact on daily life, actions taken, and difficulties faced.1 We analyzed the free-text responses to the impact question using LIWC, a computational natural language processing tool2, and performed a thematic content analysis of the reasons people gave for non-compliance with social distancing orders. Stanford University’s IRB approved the study.
In 9 days, we collected a total of 20,734 responses. 6,573 individuals provided a response (≥30 words) to the question, “Tell us how the coronavirus crisis is impacting your life.” Our data (Figure 1) show that younger people (18-31) are more emotionally negative, self-centered, and less concerned with family, while middle-aged people are group-oriented (32-44) and focused on family (32-64) (all p values < .05 corrected for multiple comparisons). Unsurprisingly, the oldest and most at-risk group (65+) are more focused on biological terms (e.g., health-related topics), but were surprisingly low in anxiety and high in emotionally positive terms relative to those at lower risk.
Mean number of words in language categories, by age group. Age groups are modeled after the age groups reported by the Center for Disease Control in their summary of COVID-19 cases in the US.3 Bars represent standard errors.
We also content-analyzed 7,355 responses (kappa’s > .75) to the question, “What are the reasons you are not self-isolating more?” Of these participants, 39.8% reported not being compliant, with the youngest group (18-31) having the lowest compliance rate (52.4%) compared to the other age groups (all > 60%; all p values < .01). Table 1 describes the seven primary themes for non-compliance. Non-essential work requirements, concerns about mental and physical health, and the belief that other precautions were sufficient were the most common reasons, although other rationales included wanting to continue everyday activities and beliefs that society is over-reacting. Childcare was an important concern for a subset of respondents.
Primary Themes for Non-Compliance and Messaging Strategies
Overall, our findings suggest that public health messages should focus on young people and 1) address their negative affect, 2) refocus their self-orientation by emphasizing the importance of individual behavior to group-level health outcomes, and 3) target the specific rationales that different people have regarding the pandemic to maximize compliance with social distancing.
Data Availability
Data are available from the authors upon request.
Acknowledgements
We would like to acknowledge the individuals who helped with the survey dissemination online.
Footnotes
Funding: EL (grants DP2CA225433 and K24AR075060) and MH (grant DP2CA225433-02) are supported by the NIH. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
↵1 Nelson LM, Simard JF, Oluyomi A, et al. US Public Concerns About the COVID-19 Pandemic From Results of a Survey Given via Social Media. JAMA Intern Med. Published online April 07, 2020. doi:10.1001/jamainternmed.2020.1369
↵2 Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015). The development and psychometric properties of LIWC2015. (https://repositories.lib.utexas.edu/bitstream/handle/2152/31333/LIWC2015_LanguageManual.pdf)
↵3 Severe Outcomes Among Patients with Coronavirus Disease 2019 (COVID-19) — United States, February 12–March 16, 2020 (https://www.cdc.gov/mmwr/volumes/69/wr/mm6912e2.htm)
