Abstract
Objective To understand COVID-19 vaccine hesitancy.
Methods January 6 through May 31, 2021, 5,121,436 US adults completed an online COVID-19 survey. Weighted data was used to evaluate change in vaccine intent and correlates of May vaccine hesitancy.
Results COVID-19 vaccine hesitancy decreased by one-third from January to May, with relatively large decreases among participants with Black, Pacific Islander or Hispanic race/ethnicity and ≤high school education. In May, independent hesitancy risk factors included younger age, non-Asian race, having a PhD or ≤high school education, living in a rural county, living in a county with higher 2020 Trump support, lack of worry about COVID-19, working outside the home, never intentionally avoiding contact with others, and no past-year flu vaccine. Differences in hesitancy by race/ethnicity varied by age. Almost half of vaccine hesitant respondents reported fear of side effects and not trusting the COVID-19 vaccine; over one-third reported not trusting the government, not needing the vaccine, and waiting to see if safe. Reasons differed by degree of vaccine intent and by race/ethnicity.
Conclusion COVID-19 vaccine hesitancy varied by demographics, geography, beliefs, and behaviors.
Introduction
The first COVID-19 vaccination was administered in the US on December 14, 20201, 3 days following the Federal Drug Administration (FDA)’s first Emergency Use Authorization of a COVID-19 vaccine2. By March 2021, 3 COVID-19 vaccines had been authorized in the US3, and the president announced procurement of enough doses for every adult to be vaccinated by the end of May 20214. By May 2021, vaccine eligibility was expanded to everyone covered under the FDA authorizations (initially ≥16 years old, expanded to ≥12 years old on May 105), and efforts to increase vaccine access to underserved populations (e.g., rural communities, homebound individuals) were underway6,7. However, vaccine hesitancy (i.e., a refusal or reluctance to be vaccinated) slowed vaccination uptake, potentially prolonging the pandemic3.
A longitudinal study of US adults (N=7,420) by Daly et al. reported an overall decrease in COVID-19 vaccine hesitancy from 46.0% in October 2020 to 35.2% in March 2021, with larger decreases in Black and Hispanic versus White race/ethnicity8, thereby reducing the racial disparity in COVID-19 vaccine hesitancy. However, if and how vaccine hesitancy has changed during the first five months of the US COVID-19 vaccine rollout, overall and among subgroups, is largely unstudied.
Among a massive sample of US adults, we report COVID-19 vaccine uptake and intent by month, January-May, 2021, and evaluate time trends by race/ethnicity, education, US region and political environment. For May, the prevalence of COVID-19 vaccine hesitancy is reported by demographics, geographic factors, political/COVID-19 environment, health status, beliefs and behaviors, and associations between each potential risk factor with hesitancy is estimated with and without adjustment for potential confounders. Lastly, we identify the most common reasons for COVID-19 vaccine hesitancy by level of COVID-19 vaccine intent and race/ethnicity.
Methods
This analysis used the COVID Trends and Impact Survey (CTIS)9, created by the Delphi Group at Carnegie Mellon University (CMU) and conducted in collaboration with Facebook Data for Good. Survey sampling is described in the eMethods. Survey weights accounting for the sampling design and non-response are post-stratified to match the US general population by age, gender, and state10. The study design ensures CMU researchers do not see usernames or profile information and Facebook does not see survey microdata.
Study sample
The analysis sample includes 5,121,436 survey responses from participants who completed the survey at least once January 6 to May 31, 2021; study flow for each month is provided in the eTable 1. Data was aggregated by month to evaluate time trends in COVID-19 vaccine receipt and intent. To inform policy and public health efforts we used the most recent month’s data (May 2021) to assess how demographics, geographic factors, political/COVID-19 environment, health status, beliefs and behaviors relate to COVID-19 vaccine hesitancy.
Measures
Participants were asked if they had received the COVID-19 vaccine, and if not, “If a vaccine to prevent COVID-19 (coronavirus) were offered to you today, would you choose to get vaccinated.” Participants were categorized as vaccine hesitant if they answered that they probably or definitely would not choose to get vaccinated (versus probably or definitely would choose to get vaccinated or were vaccinated). Those who had already received the vaccine were coded as not hesitant in order to reduce bias from differential access to a COVID-19 vaccine among subgroups over the time studied.
The survey questions and response sets utilized in this report to measure demographics, geographic factors, political/COVID-19 environment, health status, beliefs and behaviors are provided in the eAppendix. The categorization of survey variables and creation of derived variables (US Census region, state governor political party, county Trump to Biden vote share in the 2020 presidential election, and county COVID-19 death rate) are described in the eMethods.
Statistical analysis
Weighted percentages of COVID-19 vaccine receipt and intent were calculated by month for the full sample and by categories of race/ethnicity, education, US Census region, and county Trump to Biden vote share. Percentages were plotted by month and first-last month differences were calculated. The race/ethnicity comparison was limited to adults 18-34 years due to an interaction between race/ethnicity and age in relation to COVID-19 vaccine hesitancy (reported below with May data), and because hesitancy is higher among younger versus older adults.
Among the May sample, weighted percentages of COVID-19 vaccine hesitancy were calculated by all covariates (demographics, geographic factors, political/COVID-19 environment, health status, beliefs and behaviors) and a series of weighted Poisson regression models were used to estimate the risk ratios (RR) for vaccine hesitancy for each variable. Adjusted risk ratios (aRR) were estimated from a single weighted Poisson regression model including all covariates and an interaction term for age group and race/ethnicity. In a second multivariable model, a simplified health conditions variable (none, at least one; described in eMethods) was replaced with the version specifying specific conditions to estimate aRR by condition.
Finally, weighted percentages for reasons for hesitancy were calculated by level of COVID-19 vaccine intent, and by race/ethnicity among hesitant respondents. For all parameters, 95% confidence intervals (CI) were calculated using robust standard errors.8 Analyses were conducted in R (Version 4.0.2, R Core Team, Vienna, Austria).
Results
Participant characteristics
May participants (N= 529,658) had a median age range of 55-64 years, 45.0% identified as male, 52.6% female, 1.1% nonbinary, and 1.4% self-described gender; 16.7% were Hispanic, 68.7 % White, 6.5% Black, 3.6% Asian, 0.9% Native American, 0.2% Pacific Islander, and 3.4% were multi-racial; 22.5% had ≤high school education; 41.2% a four-year college degree or higher. Over half (55.7%) worked for pay; 43.2% worked outside the home. Demographics were similar in January through April (data not shown).
COVID-19 vaccine receipt and intent over time
Hesitancy decreased each month, with a one-third decrease from 25.7% (95%CI 25.6-25.8) in January to 17.1% (95% CI, 17.0-17.2) in May, 2021 (eFigure 1). There was a bigger decrease in the response “probably not” (−7.0 percentage points (%) [95% CI -7.1, -6.9]) versus “definitely not” (−1.6 % [95% CI -1.7, -1.4]) (eTable 2).
Disparities in COVID-19 vaccine hesitancy over time
Per Figure 1, from January to May the gap in percent hesitant between race/ethnicity groups among younger adults (panel A) and education levels among all respondents (panel B) decreased, with the biggest decreases among two of the three most hesitant race/ethnicity groups (e.g., Black and Pacific Islanders but not Native American) and the two most hesitant education groups (≤high school and some college education) in January. There was not a decrease in hesitancy among those with a professional degree or PhD. Changes in percent hesitant over time were fairly similar across US Census regions (panel C); however, there was less of a decrease in the Midwest and Mountain regions versus the South, Pacific and Northeast. The gap in percent hesitant by county Trump vote share increased slightly from January to May, with the highest quartile, which was the most hesitant group, having the smallest decrease (panel D). Supporting data is provided in eTable 3.
Factors related to COVID-19 vaccine hesitancy
Hesitancy in May, 2021 is reported by participant demographics and geographic factors in Table 1. Although hesitancy was lower in females versus males (RR=0.79, 95% CI 0.78, 0.81), with adjustment for covariates (i.e., variables reported in Tables 1 and 2), female versus male gender was associated with higher hesitancy (aRR=1.12, 95%CI 1.10-1.14). In contrast, non-binary adults had similar hesitancy to males (RR=1.10, 95%CI, 0.97-1.22; aRR=0.99, 95%CI 0.88-1.10).
In general, younger age and non-Asian race (particularly Multi-racial and Native American), were related to greater hesitancy. However, an interaction was observed between age and race/ethnicity categories (Figure 2). Differences in hesitancy by age (e.g., 18-24 year-olds versus 65-74 year-olds) were more pronounced in Blacks (RR=7.23 [95%CI, 5.89-8.57]) and less pronounced in Asians (RR=2.39 [95%CI 1.01-3.76]; although hesitancy <5% in all Asian age groups) compared to Whites (RR=2.94 [95%CI 2.79-3.09]). Differences in hesitancy by race/ethnicity were more pronounced in younger adults and adults ≥75 years. Furthermore, for some comparisons, the direction of the difference in hesitancy by race/ethnicity differed by age. For example, for Blacks versus Whites the RR of hesitancy was 1.28 (95%CI, 1.09-1.47) in 18-24 year olds, and 0.52 (95%CI 0.46-0.59) in 64-75 year olds. RRs for age groups stratified by race/ethnicity groups and for race/ethnicity groups stratified by age groups, with and without adjustment for all covariates, are provided in eTable 4 and 5. In general, age and race/ethnicity differences were attenuated in the full multivariable model, but still present.
The association between hesitancy and education level followed a U-shaped curve with the lowest hesitancy among those with a master’s degree (RR=0.75 [95% CI 0.72-0.78] and the highest hesitancy among those with a PhD (RR=2.16 [95%CI 2.05-2.28]) or ≤high school education(RR=1.88 [95%CI 1.83-1.93]) versus a bachelor’s degree. Additional demographic risk factors for hesitancy included working outside the home (RR=2.48 [95%CI 2.39-2.57]) or not working for pay (RR=1.49 [95% CI: 1.43-1.54]) versus working at home, living in the South (RR=1.59 95%CI 1.55-1.64]), Midwest (RR=1.50 [95%CI 1.46-1.55]) or Mountain (RR=1.49 [95%CI 1.43-1.55]) versus the Pacific US region, and in a less urban county (e.g., RR=2.34 [95 CI, 2.27-2.41] for non-core versus large central metro). Associations were attenuated with adjustment, but remained (Table 1).
COVID-19 vaccine hesitancy is reported by indicators of political/COVID-19 environment, health status, beliefs and behaviors in Table 2. Risk factors for hesitancy were living in a state with Republican versus Democratic governor (RR= 1.33 [95%CI 1.31-1.36]), living in a county with a relatively higher Trump vote share (e.g., RR= 2.55 [95%CI 2.48-2.62] for highest versus lowest quartile), living in a county with a relatively lower April COVID-19 death rate (e.g. RR=0.70 [95%CI 0.68-0.73] for highest versus lowest quartile), history versus no history of a positive COVID-19 test (RR= 1.24 (95%CI 1.22-1.27]), not having versus having a high-risk health condition (RR=1.41 [95%CI 1.39-1.43]), being less worried about self or immediate family becoming seriously ill from COVID-19 (e.g., RR=3.82 [3.74-3.91] for not worried at all versus worried), not having had versus having had a past-year flu vaccination (RR=5.06 [95%CI 4.94-5.18]), and not avoiding versus avoiding contact with others (e.g., RR=4.03 [95%CI 3.92-4.15] for none versus all of the time). Political affiliation of state governor was excluded from the multivariable model due to collinearity with county Trump vote share. The adjusted associations were attenuated but in the same direction, except for April 2021 COVID-19 death rate, which was not independently related to hesitancy.
COVID-19 vaccine hesitancy by specific health conditions is provided in eTable 6. Compared to participants reporting none of the queried high-risk health conditions, hesitancy was lower among participants with each health condition category except weakened or compromised immune system (RR 1.09, [95%CI 1.00-1.17]; aRR 1.41 [95%CI 1.32-1.51]). Most health condition associations were attenuated with adjustment.
Reasons for COVID-19 vaccine hesitancy
Reasons for hesitancy by level of intent (definitely not - probably yes) are reported in Table 3. Concern about side effects was chosen most frequently at 49.2% (95%CI, 48.8-49.7) among all hesitant participants, and similarly common among all levels of intent. In contrast, not trusting the COVID-19 vaccine and not trusting the government were the most frequent reasons for hesitancy among adults who would “definitely not” choose to be vaccinated today (59.6 % [95%CI, 59.0-60.1] and (52.3% [95%CI, 51.7-52.8], respectively), double the prevalence seen among the “probably not” group and almost quadruple the prevalence the “probably yes” group. Conversely, 52.2% (95%CI, 51.5-53.0) of the “probably not” group said they would wait to see if it was safe, versus only 24.2% (95%CI, 23.7-24.8) of the “definitely not” group. Compared to most reasons for vaccine hesitancy (i.e., the reasons listed above plus don’t need, concerned about allergic reaction, don’t know if it will work), not liking vaccines in general was chosen less frequently overall and among subgroups (<20% for all).
Reasons for COVID-19 vaccine hesitancy among hesitant US adults by race/ethnicity are provided in eTable 7. Concern about side effects, followed by not trusting the COVID-19 vaccine, were the most common concerns in all race/ethnicity groups, with the ranking reversed among Native Americans. Both were chosen by >40% of each group except Asians (39.3% [95%CI, 32.3, 46.3]) reported not trusting the COVID-19 vaccine). There was more racial/ethnicity variability in not trusting the government, which was highest among Multiracial adults (52.4% [95%CI, 50.2-54.5]), followed by Native Americans (44.0% [95%CI, 39.5-48.5]), Whites (43.7% [95%CI, 43.2-44.3], and Hispanics (41.0% [95%CI, 39.5-42.6]); in waiting to see if safe, which was highest in Hispanics (41.6%, 95%CI, 40.1-43.2), followed by Asians (40.8% [95%CI, 33.8-47.7]) and Blacks (40.7% [95%CI, 38.6-42.8]); and in do not need, which was highest in Multiracial (48.5% [95%CI, 46.3-50.7]), and Whites (42.1% [95%CI, 41.5-42.7]). Other reasons were chosen by <40% of hesitant adults in each race/ethnicity group.
Discussion
In this massive national survey of US adults, COVID-19 vaccine hesitancy decreased by one-third between January and May, 2021. A reduction in hesitancy was observed across all race/ethnicity groups, US regions and county political environments, and most education levels, though subgroups decreased at different rates, with large variations by race/ethnicity and education groups. The reduction in hesitancy was primarily due to a decrease in the percentage responding they would “probably not” accept the vaccine, as there was minimal change in the percentage “definitely not”. May 2021 data indicates that five months into the US COVID-19 vaccine rollout, a wide array of demographic, health, political and COVID-19 environment, beliefs and behavioral factors independently contribute to COVID-19 vaccine hesitancy: age, race/ethnicity, education, county urban classification, county political environment, extent of worry about a serious illness from COVID-19, extent intentionally avoiding contact with others, and past-year flu vaccine history chief among them. Additionally, important differences in reasons for COVID-19 vaccine hesitancy exist both by degree of vaccine intent and racial/ethnic groups.
Large decreases January-May in COVID-19 vaccine hesitancy among Blacks and Pacific Islanders led to these groups joining Asian and Hispanics as having a lower prevalence of hesitancy than Whites (all age groups combined) in May 2021. Racial/ethnic disparities have been observed in all aspects of the COVID-19 pandemic, with communities of color experiencing higher rates of SARS-CoV-2 infection (despite higher positivity rates indicative of lower access to testing11), COVID-19-related hospitalizations and mortality11. Racial/ethnic disparities in COVID-19 vaccine acceptance at the start of the vaccine rollout threatened to continue this trend. However, many groups from at-risk communities initiated targeted outreach campaigns12. Our finding that racial/ethnic disparities in COVID-19 hesitancy are decreasing suggests that messaging and outreach campaigns, combined with the opportunity to observe initial months of the rollout, have had positive effects. However, vaccination rates for Black and Hispanics continued to lag through July 6, 202113, indicating that further efforts are needed to overcome barriers to access for at-risk communities.
Most previous studies of COVID-19 vaccine hesitancy grouped Asians with American Indian/Alaska Native, Native Hawaiian or other Pacific Islanders8,14–16 However, our study, which included 12,012 Asian participants, identified a remarkably lower prevalence of hesitancy in this race/ethnicity group versus all others. This study also identified a race/ethnicity by age interaction, yielding greater insight into the gross patterns of each factor, which had previously been identified as key predictors of vaccine hesitancy8,17. For example, Blacks have relatively high hesitancy among adults under 35 years while Whites have relatively high hesitancy among adults 45 and older. In contrast, Native Americans and Multi-racial groups have particularly high hesitancy, and Asians low hesitancy, across age groups.
The large decrease in COVID-19 vaccine hesitancy January-May among those with ≤high school education went a long way towards narrowing the education gap; still this group has a relatively high hesitancy prevalence. Those with professional degrees (e.g., JD, MBA) and PhDs were the only education groups without a decrease in hesitancy, and by May, those with PhDs had the highest hesitancy. To our knowledge, no other study has evaluated education with this level of granularity, which was possible due to our unusually large sample size (>10,000 participants with PhDs). Further investigation into hesitancy among those with a PhD is warranted.
January-May, there was a dose-response relationship between relative degree of local Trump support in the 2020 presidential election and hesitancy, that grew slightly over time such that by May those living in counties in the top quartile were 42% more at risk for being hesitant, highlighting the politicization of public health recommendations.
Adults who were “not worried at all” about themself or someone in their family becoming seriously ill from COVID-19 or who were not intentionally avoiding contact with others had much higher likelihood of COVID-19 vaccine hesitancy, as did those working outside the home. These latter two findings are particularly concerning as they indicate non-vaccinated (versus vaccinated) individuals may be more likely to engage in activities in which transmission can occur. While prior studies have linked history of past-year flu vaccine with hypothetical COVID-19 vaccine acceptance14,16, our finding that those who had not received a flu vaccine were 224% more likely to be COVID-19 vaccine hesitant, after controlling for such a wide array of covariates, is striking.
Even prior to COVID-19, vaccine hesitancy was identified as one of the top ten global health threats by the World Health Organization (WHO)18, This is because incomplete vaccine coverage increases the risk of disease for the entire population19. This study’s county-level variables raise concerns, as high hesitancy areas could provide reservoirs for the Sars-CoV2 virus, even if national or state level vaccination rates increase.
Five months into the vaccine rollout, concern about side effects was common across levels of COVID-19 vaccine intent (49%) and among all racial groups (range: 42-58%). However, several reasons for COVID-19 vaccine hesitancy varied substantially by groups. For example, those who would definitely not versus probably not choose to be vaccinated were about twice as likely to say they don’t trust the COVID-19 vaccine, don’t trust the government, and/or don’t need the vaccine. Conversely, those who would probably not versus definitely not choose to be vaccinated were twice as likely to say that they are waiting to see if it will be safe and might take it later.
Limitations and Strengths
The study employs a novel sampling method with a soft ask and low response rate, the effect of which has not yet been fully studied. Survey weights adjust for non-response and coverage bias (i.e., matching the sample to gender, age, and geographic profile of the US). However, a comparison with the American Community Survey20 shows our sample is more educated with higher vaccine uptake than general population, indicating that vaccine hesitancy is underestimated in this sample. Importantly, these characteristics have been consistent over time. CTIS results follow similar patterns observed by others,8 and have been helpful for tracking trends, understanding associations and informing policies21,22. Demographic questions were asked at the end of the survey and had high unit non-response (e.g., 12% for age), which was treated as a category in analysis. Additionally, we assume the survey was completed in good faith. However, a review of fill-in responses for self-described gender suggest a small percentage of participants used that category to make political statements (e.g., trans-phobic comments). A sensitivity analysis eliminating respondents with self-described gender produced very similar results, though the increase in hesitancy for those age ≥75 years was attenuated (data not shown). A strength of our novel sampling method is that it yielded a large sample with diverse characteristics that enabled detailed subgroup analyses that identified new findings (e.g., non-binary and male genders had similar hesitancy prevalence). Additionally, while a previous study evaluated changes in hesitancy by age, sex, education, or income level, October 2020 through March 20218, estimated change by these categories had large overlapping 95% CI, likely in part reflecting the much smaller sample size. Further, the racial and education categories (White, Hispanic, Black, Other; and Yes/No College Degree) collapsed groups in which we have identified meaningful differences.
In the US, the COVID-19 vaccination campaign has moved from an initial phase of scarcity, where equity concerns guided access, to a phase of abundance, where messaging and attention to barriers to access is essential to equity, and where increasing vaccine acceptance is critical to achieving herd immunity. Better understanding of reasons for hesitancy among subgroups, combined with up-to-date information on hesitancy by demographics, political environment, and individual health, behaviors and beliefs can help policy makers achieve these goals. Particularly hesitant subgroups include Native American and Multi-racial groups of all ages, and White and Blacks adults <35 years; adults with ≤high school education or PhDs; adults living in small metro, micropolitan or non-core urban (rural) counties or counties with high Trump support; adults with a history of a positive COVID-19 test; not worried about serious illness from COVID-19; working outside the home; never intentionally avoiding contact with others; and adults who did not receive a past-year flu vaccination. Among participants who said they probably would not get vaccinated today, messaging about safety and policy interventions to address downstream impacts of vaccine side effects, such as potential lost work, could be impactful. However, among those who definitely would not get vaccinated today, results suggest the existence of a subgroup with entrenched hesitancy and high distrust of government that may be hard to reach.
Data Availability
Survey microdata is available to researchers under a nondisclosure agreement protecting the confidentiality of responses. Access can be requested at https://cmu-delphi.github.io/delphi-epidata/symptom-survey/.
https://cmu-delphi.github.io/delphi-epidata/symptom-survey/coding.html
Footnotes
mrubinst{at}andrew.cmu.edu
areinhar{at}stat.cmu.edu
rmejia{at}andrew.cmu.edu