Abstract
Both private and public benefits result from vaccination for transmissible diseases, such as seasonal influenza, measles, and COVID-19. To help inform vaccination efforts for such diseases, we ask whether social preferences—concerns for the well-being of other people—influence one’s decision regarding vaccination. We measure these social preferences for 549 online subjects: We give each subject $4 to play a public-good game and make contributions to public welfare. To the extent that one gets vaccinated out of concern for the health of others, contribution in this game is analogous to an individual’s decision to obtain vaccination. We proxy vaccine demand with individuals’ delay to initially vaccinate for COVID-19. We collect COVID-19 vaccination history separately to avoid experimenter-demand effects. We find a strong result: Contribution in the public-good game is associated with greater demand to voluntarily receive a first dose, and thus also to vaccinate earlier. Compared to a subject who contributes nothing, one who contributes the maximum ($4) is 48% more likely to obtain a first dose voluntarily in the four-month period that we study (April through August 2021). People who are more pro-social are indeed more likely to take a voluntary COVID-19 vaccination. We thus recommend further research on the use of pro-social preferences to help motivate individuals to vaccinate for transmissible diseases, such as the flu and HPV.
1. Introduction
Vaccination, in addition to sanitation and clean drinking water, has had a massive effect on public health. Vaccines prevent an estimated 6 million deaths annually (Rodrigues and Plotkin 2020). Beyond morbidity and mortality prevention, workers are more productive, economic growth greater, and equity enhanced. Despite these private and public benefits, vaccine hesitancy continues to pose a challenge to society. Addressing COVID-19 vaccination hesitancy remains a top priority in public health (Krause, Gruber, and Offit 2021). While largely vaccine-preventable, seasonal influenza annually causes 200,000 to 800,000 hospitalizations and 20,000 to 60,000 deaths in the U.S. (CDC 2020a). Further, clusters of measles cases have recurred in countries with eradication status, and greater HPV vaccination would confer cost-effective health benefits (Maldonado, O’Leary, and Hotez 2022; Chesson et al. 2011).
While the strongest personal motivation for vaccination is most likely the direct benefits to one’s own health, the decision to vaccinate could be influenced by a variety of pro-social concerns, such as helping one’s community, even when many other people are not vaccinated (a preference for altruism). One may wish to vaccinate to help attain herd immunity (reflecting altruism, a desire for social efficiency, or some combination). Finally, one may wish to do one’s fair share (a preference for equity) if many other people in their community are vaccinated.
Immunity to communicable disease is a public good (Althouse, Bergstrom, and Bergstrom 2010). When one vaccinates against many communicable diseases (e.g., the flu, measles, HPV, or COVID-19), one incurs personal health benefits, and vaccination lowers transmission rates to others (Wissing et al. 2019; CDC 2021b, 2020b, 2021a). As with other public goods, a free-riding problem exists in vaccination. One has a high incentive to vaccinate if no one else is vaccinated against a prevalent communicable disease, but a much lower incentive if most other people are vaccinated. While immunized individuals are still susceptible to infection, broader vaccination reduces community transmission.
For example, Loeb et al. (2010) find that vaccinating school children and adolescents for influenza protects non-immunized community members (attributed to decreased transmission in schools). Similarly, White (2021) finds that each flu vaccination among the general population of the United States generates $63 of benefits from reduced mortality and $87 of benefits from work hours gained. Vaccination against HPV provides significant private benefits to both women and men, and the vaccination of each group helps protect the other (Elbasha and Dasbach 2010). Regarding COVID-19 vaccination, Oliu-Barton et al. (2022) estimate that French vaccination certificate regulations saved an average of €685 of economic output per vaccination.
Regarding social preferences, the essential content is that people deliberately sacrifice money or other resources to help (or hurt) others, to establish equity or efficiency, or to increase the economic surplus for the whole group. As one indicator of the importance of social preferences, Americans donated over $500 billion to charitable organizations in 2020. The fact that people do not simply maximize their own material payoffs has important consequences for public health.
Although subjects in laboratory experiments are frequently concerned with the payoffs of others, some question whether this behavior is generally present in the field. We implemented an incentivized public-good game to measure social preferences, endowing each online participant in anonymous groups of four with $4. Each person chose how much of their $4 to contribute to a public good, while retaining the remainder. We then doubled the group’s total contribution and distributed it evenly to all participants. Thus, each player receives back half of what they contributed, while providing benefits for the group. The socially-optimal choice would be for each person to contribute $4 to the pot, so that each person earns $8; however, free-riding is the dominant individual strategy to maximize material payoffs. To the extent that one gets vaccinated out of concern for the well-being of others, voluntary vaccination is analogous to this public-good game. One may (perhaps reasonably) believe that vaccination is not directly worthwhile, considering only one’s private benefits and costs; however, one certainly benefits from the vaccination of others.
In a separate survey, we asked participants to report being vaccinated for COVID-19 and, if so, the date of their first dose. COVID-19 vaccination is an ideal case study—widespread and expedient uptake was sought, which allows us to use one’s delay to vaccinate over a four-month period as a proxy for vaccine demand. To avoid any contamination and potential experimenter-demand effects, we conducted the COVID-19 vaccine survey in a separate session about one month before the social-preference game, using a different researcher identity.
We sampled individuals who reported being unvaccinated during an earlier survey in April 2021. Participants then completed a COVID-19 survey in mid-August and incentivized games in September and October. To control for local factors such as availability of vaccines and social norms, we use national data to estimate the daily vaccination (hazard) rate of a first dose among the unvaccinated for each U.S. county from April 10 to August 13, 2021. We model min {demand, supply}, including the daily number of doses available per capita in a state, daily county-by-day COVID-19 case rates, test positivity rates, vaccination rates, and a time trend. These public data account for substantial heterogeneity by obtaining county-by-day predicted first-dose demand.
Finally, we model the behavior of our participants. We assume that an unvaccinated individual’s demand for a first dose (their hazard rate of vaccination) is proportional to their pro-social preferences (as measured in the public-good game) and the hazard rate for a representative unvaccinated person in their county on each day. We separately model vaccination that participants attribute to a mandate at work or school, because pro-social preferences should have a lesser role in this case.
We consider the correlation between social preferences and vaccination behavior; prior research has studied intent to receive a hypothetical vaccination (often for a flu virus), as well as COVID-19 prophylactic behavior (e.g., masking, handwashing). Studies on this topic have shown some conflicting results, as described in our literature review. While there is some evidence (e.g., Milkman et al. 2022) that nudges or directives help to induce more pro-social behavior, some studies have failed to demonstrate this (e.g., Campos-Mercade et al. 2021a). We measure social preferences from behavior in an incentivized public-good game, a relatively uncommon methodology in the vaccination literature. We completely separate social-preference elicitation from measurement of vaccination behavior, as we conduct these sessions a month apart under different researcher identities. Campos-Mercade et al. (2021b) used similar techniques to study COVID-19 prophylactic behavior.
We are one of the first to study the relationship between social preferences and vaccination behavior (as opposed to self-reported intent to vaccinate).4 We capture the vaccination behavior of our participants during the first four crucial months that the COVID-19 vaccines were available to the general public of the United States.5 Finally, participants who report having taken the vaccine due to a mandate at work or school likely have different motivation; our model permits these motivations to differ. In total, we use an innovative methodology to offer unique findings on the association between trait-level social preferences and actual COVID-19 vaccination in the field.
Our results are striking: Compared to a subject who contributes nothing, one who contributes the maximum ($4) is on average 48% more likely to obtain a first dose voluntarily in the four-month period that we study (April through August 2021). That is, pro-social preferences are strongly positively associated with voluntary vaccination.
While our evidence is consistent with the hypothesis that pro-social preferences increase voluntary vaccination against COVID-19, these results do not necessarily translate directly to policy advice on COVID-19 vaccination efforts. To the extent that our results are relevant to vaccination for transmissible diseases writ large, pro-social motivation may be successfully harnessed to increase vaccination for the flu (as by Milkman et al. 2022), HPV, or measles.
2. Prior literature
The literature on pro-social motivations comprises two strands—studies that investigate the association between pro-sociality and vaccination, and interventions that rely on pro-sociality to increase vaccination. Many studies use non-incentivized survey questions to measure pro-social preferences, while a few have incentivized games. These studies ask participants to report their intent to vaccinate against a real infectious disease. Böhm and Betsch (2022) offer a timely review of studies conducted prior to 2020, mainly concerning flu vaccines. Some of these studies find an association between pro-social preferences and vaccination, while others do not.
For example, Hershey et al. (1994) survey patients at a student health clinic about intent to vaccinate against a hypothetical influenza disease. While altruism, free-riding, and herding all motivate the intent to vaccinate, there is no evidence that stressing societal benefits of vaccination increases this intent. Betsch et al. (2017) test whether explaining the concept of herd immunity to participants increases their reported intent to vaccinate in fictitious scenarios. Contrary to the research hypothesis, this intervention increases reported intent to vaccinate among residents of Western countries, but not those of more-collectivist Eastern countries. Amin et al. (2017) find no association between intent to vaccinate and self-reported attitudes toward fairness and pro-sociality. Betsch and Böhm (2018) study the interaction of an intervention that explains the social benefits of vaccination with one’s self-reported attitudes toward fairness and pro-sociality, finding no interactive effect. Böhm, Betsch, and Korn (2016) find marginal evidence that subjects more cooperative in dictator games were more likely to choose to “vaccinate” in a framed laboratory game. In the field, Milkman et al. (2022) find that text messages sent to encourage flu vaccination increase uptake. Message content that emphasizes the protection of others is beneficial; however, some messages without social concerns perform better, and other messages worse.
In the context of COVID-19, Pfattheicher, Petersen, and Böhm (2021) find that knowledge about the social benefits of COVID-19 vaccination is associated with greater intent to vaccinate among respondents residing in the United Kingdom (U.K.). These authors also find that an intervention that explains the social benefits of vaccination increases self-reported intent to vaccinate. Freeman et al. (2021) conduct a study of COVID-19 vaccination intentions among 15,014 U.K. residents solicited from a variety of sources, including TV, radio, and mail campaigns. These authors find no effect of information provision regarding the societal benefits of COVID-19 vaccination. In fact, the authors find that providing strongly-hesitant respondents with information on the private benefit of vaccination increases stated intent to vaccinate for COVID-19, but that the addition of information about collective benefits reduces intent to vaccinate. These mixed results echo those from studies conducted pre-COVID-19.
There are at least a handful of other papers that consider pro-sociality or personality traits as predictors of vaccination. Zettler et al. (2022) finds COVID-19 health behaviors to be correlated with different personality traits such as agreeableness and honesty-humility. Bargain and Aminjonov (2020) examine political trust in Europe in relation to the pandemic, concluding dramatically that “degraded trust presents a risk for collective survival in the face of a pandemic”. Müller and Rau (2021) report survey data suggesting that risk tolerance negatively affects compliance to social distancing. Campos-Mercade et al. (2021b) correlate pro-sociality with health behavior in two surveys involving a broadly representative sample of the Swedish population, finding a relationship between stated prophylactic COVID-19 behaviors (e.g., wearing a face mask, reporting infection) and the willingness to expose another person to financial risk for one’s own financial benefit. And while Milkman et al. (2022) find that text-message nudges sent to encourage flu vaccination increase uptake, Campos-Mercade et al. (2021a) do not find that a nudge that stresses that the COVID-19 vaccine protects others and increases vaccination uptake (both studies use administrative vaccination records). Thus, a consensus view has not yet emerged. We contribute to this discussion using vaccination timing as a proxy for vaccine demand and lab-in-the-field incentivized games.
Regarding the latter, much of the evidence for social preferences in economics has come from simple games in laboratory experiments. There are concerns that laboratory measures of social preferences may not translate into consistent behaviors outside of the lab (Gneezy and List 2006; List 2006; Levitt and List 2007). At the same time, field behavior often matches experimental behavior (e.g., Falk and Heckman 2009; Bellemare, Bissonnette, and Kröger 2014). For example, Meier and Sprenger (2008) note that people who display more present bias in the lab also are more likely to carry large credit-card balances. Carpenter and Seki (2005) observe that conditional cooperation in a public-good game predicts group fishing productivity in Japan. Fehr and Leibbrandt (2008) show that public-good-game contributions and patience predict limits on common-pool resource extraction by Brazilian fishermen, and Barr and Zeitlin (2010) find that dictator-game allocations made by Ugandan teachers correlate with their actual (discretionary) teaching time. Carpenter and Myers (2010) find that dictator-game allocations by Vermont residents predict their willingness to volunteer to fight fires.
Thus, we ask whether the choices made in a simple game with modest-but-real stakes inform us to any degree about vaccination behavior. We find that it does.
3. Methodology
We focus solely on an individual’s first vaccine dose for simplicity.6 Because we can no longer observe behavior from that individual once they receive their first dose, we use a survival analysis. The hazard rate is the probability of receiving a first dose conditional on being unvaccinated. Given a relatively small sample of individuals, we control for the many influences that affect the demand (and supply) of a first dose.
We begin by modeling this hazard rate using public daily county data to account for heterogeneity across time and geography in factors affecting the supply of and demand of vaccines. A linear lasso procedure selects among candidate co-variates and predicts vaccine demand in U.S. county c in state s on day t. This estimate is the daily probability of receiving a first dose, conditional on never having received a dose. We use this estimated hazard rate as a control variable in our main regression.
Turning to our participant data, our model considers whether vaccination is voluntary or if the respondents said it was mandated by their employer or school. We use a proportional hazard model with two covariates— predicted hazard rate for each participant’s county c in state s on day t and each participant’s contribution in our public-good game. We then test our primary hypothesis that pro-social preferences, as measured in the public-good game, predict demand for a first dose of a COVID-19 vaccine.
3.1. Modeling the hazard of a first dose for each county-day
Our main control variation is the hazard rate of receiving a first dose, estimated for each county and date.
An individual faces costs in getting vaccinated; these include time spent finding an available vaccine dose and traveling to the clinic. If vaccine doses are extremely scarce, an individual may spend a considerable amount of time searching for an available appointment and may be willing to travel farther. At the margin, these costs likely translate to a lower first-dose hazard rate. To capture the effect of vaccine scarcity, we consider the number of vaccine doses that are available per person on any given day. The CDC (2022c) report the daily number of doses delivered to every state, as well as the number administered, both per capita. We consider the difference to be the number of doses available per capita, of which we take a seven-day moving average.
We also consider county-level factors that influence an individual’s private benefit from vaccination. This benefit increases with a higher local case rate, so we include the number of new cases per capita recorded in a county over the last seven days. Because limited testing can underestimate case rates, we also include the local percentage of tests reported positive over the last seven days. One’s decision may also be affected by salient data such as the worst case and test-positivity rates experienced locally. For example, if there have been severe local rates, the consequences of high community transmission may be more salient. So, we also include the maximal test-positivity and cases-per-capita rates to date for each county. All county-level case and test-positivity data come from the CDC (2022d).
One also incurs greater benefits from vaccination when fewer individuals in one’s community are vaccinated. To capture this, we include the proportion of county residents who have received a first dose and the proportion who have completed their vaccination series, both as seven-day moving averages. These county-level vaccination data come from the CDC (2022b). Due to differences with B1.617.2 (“Delta”), we include an indicator of whether the variant had yet emerged in the U.S., as reported by the CDC (2022a). We also interact this indicator variable with the previous variables, to capture differences in the costs and benefits for this variant, and further include the variables above with a one-week lag. Public policy regarding testing, test reporting, vaccination, incentives, and mandates are all highly-politicized in the United States, so we include an indicator of whether the state governor is a member of the Republican party (Kaiser Family Foundation 2021). We also include a time trend.
Finally, the regressand of interest is the hazard rate for a first dose in the county that day. We construct the probability that an adult becomes vaccinated, conditional on being an unvaccinated adult within county c in state s at time t, as
where vaccine dose adult pctc,s,t is a seven-day moving average of the percentage of adults receiving a first dose in county c on day t, again from the CDC (2022b).
We employ a linear lasso to select among the variables described above, which are also listed in Table 1. We use the resulting model to predict for every county on every day. We merge these predictions to our participants by county-day. We use approximated geolocation of each participant’s zip code, some of which span multiple counties. If multiple counties match, we use the county with the largest share of residential addresses in the given zip code, according to data from Housing and Urban Development (2021). The inclusion of these predicted hazard rates absorbs a substantial amount of variance from our regressions of vaccination behavior reported by our participants.
Variables used in the linear lasso to predict dose hazard ratec,s,t
3.2. Modeling the hazard rate of vaccination in our sample
We now analyze the timing of first doses in our participant sample. We consider two possible causes of vaccination for any individual: voluntary or compelled by a mandate. Suppose an individual decides on April 1st to wait to take her first dose voluntarily. In June, her employer gives her two weeks to take a first dose to retain employment; she complies. In this sense, she was at risk for both non-mandated and mandated vaccination, until she took her first dose under pressure. Had she not been vaccinated under a mandate, she may have vaccinated voluntarily regardless in August, but we cannot observe this counterfactual behavior. More formally, each individual’s behavior is characterized by two choices—the time at which she would take a first dose without a mandate, and the time at which she would take a first dose under a mandate. We observe only the first of these events (or neither).
We base our statistical approach on our hypothesis. Because we are primarily interested in pro-social motivation to vaccinate, we focus on voluntary vaccination. With our first approach—analysis of the cause-specific hazard—we consider individual behavior in a hypothetical world without any vaccination mandates. This approach is appropriate to investigate whether pro-social preferences are associated with an individual’s decision to vaccinate in the absence of a mandate.
To this end, we use a Cox proportional-hazards model and censor individuals who become vaccinated due to a mandate at work or school (Pintilie 2007).7 We specify first-dose hazard not attributed to a mandate as
where h0(t j) is the baseline hazard (the hazard given covariate values of zero), contributioni ∈ {0, 0.5, …, 4} is the contribution of individual i in the public-good game, and
is the predicted first-dose hazard in that county that day (as described in the previous section). We asked respondents to report the date of their first dose in bins of roughly 10 days with midpoints {t j} to facilitate responses to our survey.8
We do not apply the Cox regression to vaccination attributed to a mandate. This method would only be appropriate to investigate vaccination attributed to a mandate in a hypothetical world without voluntary vaccination. Our primary approach of studying the cause-specific (non-mandated) first-dose hazard assumes that vaccination due to a mandate is uninformative. However, individuals who attribute their vaccination to a mandate may possess characteristics that would also inform their decision of when to vaccinate without mandate. In Appendix C, we present similar results with a competing-hazards model (Fine and Gray 1999).
4. Results
4.1. Description of the sample
We initially recruited U.S. residents from Prolific’s participant pool April 7–27, 2021, using a single-question survey asking their vaccination status.9 Prolific is a marketing firm that maintains a pool of survey respondents. We over-sampled participants who had already self-identified with Prolific as Black, Latinx, Hispanic, a parent, or politically conservative; we sought these characteristics for a separate study.
We conducted Session I on August 12 and 13, 2021. We asked about participants’ COVID-19 vaccination history, receiving 601 responses. We conducted Session II from September 11 to October 13, 2021. We collected 549 responses in Session II, run under a different co-author’s profile to avoid any experimenter-demand effects from Session I. Participants played the public-good game during Session II and our software randomly-matched them with other participants. The participants’ choices determined payments in the game, which we made within 24 hours of participation.
Of our 549 participants, three did not indicate whether they had been vaccinated. Of the remainder, 306 reported being unvaccinated and 240 reported being vaccinated. Of the vaccinated respondents, seven were unsure of the date or did not report one. Our analysis thus generally reports on the 539 respondents who participated in the public-good game and who also provided their vaccination status and, if so, the approximate date of their first COVID-19 dose.
Figure 1 depicts the vaccination timing, as well as some participant characteristics. Our respondents are younger than the general population of the United States. Most of our participants have at least some college education; many have a college degree. Roughly one-third of our sample identifies as Republican, one-third Democrat, and one-third either “Independent” or “other.” 15.4% of vaccinated subjects (37 of 240) attributed their vaccination to a mandate at work, at school, for travel, or to attend social events or restaurants.10
Participant characteristics
Recall that in the public-good game, we gave participants a $4 bonus from which they could contribute any amount to a pot that doubled and was then split equally among their group of four randomly-chosen participants. The mean and median contribution was $2; Figure 1 provides more detail. We note that many experiments find initial contributions average 40–60% of the social optimum (Ledyard 1995).11
4.2. Inference
We now consider our primary hypothesis that contribution in the public-good game, our measure of pro-social preferences, is positively associated with vaccination. We consider results from the Cox model, with regression results shown in Table 2 and Figure 2. Recall that this approach focuses on vaccination not attributed to a mandate, in a hypothetical world without any vaccination mandates. An additional dollar contribution in this game is associated with a 12% greater daily hazard of vaccination not attributed to a mandate. Table 2 shows that an individual contributing the full $4 in the game is 1.48 times more likely to vaccinate (not due to a mandate) at any time (Column 1, p = 0.024; Column 2, p = 0.020) than one contributing nothing. This provides strong support for our hypothesis that pro-social preferences predict voluntary vaccination.12
Cox regressions of vaccination hazard (not attributed to a mandate)
Cox regression of vaccination hazard not attributed to a mandate
The coefficient on the contribution in the public-good game is the additional vaccination (hazard rate or ratio) per dollar of contribution, conditional on the covariates. When we use no other covariates (as in Table 2, Column 1), the baseline vaccination hazard is estimated entirely from our own sample. When we use the predicted value for each county (Column 2), the baseline hazard is calculated for our sample, but conditional on what would be predicted for the average person in that county on that date. This demonstrates that our results are robust to the best predictions for our subjects by using relevant public-health data.13
5. Conclusion
We ask whether social preferences—concerns for the well-being of other people—influence one’s decision regarding vaccination. Our sample consisted of unvaccinated U.S. residents as of April 2021, and we collected vaccination history through August 2021. People who are more pro-social in the game are more likely to get a voluntary vaccination (and to get it earlier). Compared to a subject who contributes nothing, one who contributes the maximum ($4) is 48% more likely to obtain a first dose voluntarily in the four-month period that we study (April through August 2021).
Whether policy-makers can harness pro-social preferences to increase vaccination remains an open question. Prior experimental evidence on hypothetical vaccination finds mixed success (see Section 2). However, vaccination in the field differs from hypothetical vaccination, and COVID-19 vaccination is particularly hampered by politics and misinformation. We separately consider how our findings may inform efforts to increase vaccination for influenza, HPV, and COVID-19.
Influenza vaccination, like COVID-19 vaccination, confers less protection to the elderly compared to younger people, while the disease poses far greater health risks to the elderly (CDC 2021a; DiazGranados et al. 2014). Epidemiologists have suggested that vaccinating school children would yield greater social benefits than vaccinating the elderly, because the decrease in transmission among children in schools attributed to the immunization of another child is more beneficial than immunizing another elderly person (Medlock and Galvani 2009; Galvani, Reluga, and Chapman 2007). Many public schools in the U.S. offer flu vaccine clinics, for which parental consent must first be obtained. As one example of a simple intervention, when obtaining informed consent, clinic administrators could provide parents with information sheets that emphasize how vaccination of their own children saves the lives of elders in their community—perhaps a child’s own grandparents.
HPV vaccination is currently recommended by the CDC to both men and women of ages 11 to 26. For HPV infections acquired in 2018, the lifetime cost for all women of ages 15–59 in the U.S. was $543 million, while for men the costs totaled $205 million (Chesson et al. 2021). Men clearly have less private incentive to vaccinate for HPV than do women, yet one’s vaccination benefits the public at large. By 2018, 55% of females of ages 18–21 had taken a first HPV vaccine dose, while only 34% of men had done so (Chen et al. 2021). When recommending HPV vaccination, a primary care provider could stress to a young male patient that his own vaccination could prevent his future wife acquiring cervical cancer, the fourth-leading cause of cancer among women (Hirth 2019).
Similar interventions suggest less potential upside for COVID-19 vaccination promotion. Many pro-social individuals have already vaccinated for COVID-19 (as seen in our study); further, many of the holdouts are likely more galvanized against vaccination for COVID-19 than for the flu. Field interventions involving pro-social motivators might be worthwhile to test; however, by July 2022 (when we are writing), those unvaccinated for COVID-19 may be more concerned with personal risks than public benefits (e.g., Freeman et al. 2021).
Monetary incentives have the possibility to increase vaccination, but policy-makers ought to consider potential adverse effects. Low monetary incentives can crowd-out pro-social behavior (Gneezy and Rustichini 2000). Low financial incentives may reduce the “warm glow” felt by individuals who vaccinate out of concern for others. Further, low monetary incentives may also lead individuals to believe that social benefits are lower than they really are, also potentially decreasing pro-social vaccination. Evidence typically supports the effectiveness of monetary incentives to vaccinate for COVID-19, but not always.14
Our study finds marginally-significant evidence that vaccination attributed to a mandate is associated with weaker pro-social preferences (see Appendix C). We would expect individuals with weaker pro-social preferences to respond more strongly to private incentives, including workplace and school mandates. However, even if this weak result holds, it does not imply that mandates will necessarily be effective. Additional widespread mandates may reduce the warm glow felt by individuals who vaccinate out of concern for others. However, Karaivanov et al. (2021) find evidence that COVID-19 vaccination mandates are very effective overall, limiting such a concern. Schmelz and Bowles (2021) note that the implementation of mandates may increase COVID-19 vaccination hesitancy. Indeed, mandatory policies can foster mistrust and backlash (Falk and Kosfeld 2006).
Given the challenges with existing approaches to increase COVID-19 vaccination uptake, policy-makers and researchers may yet experiment with means to harness pro-social motives, but ought also address individuals’ beliefs regarding private benefits and risks. To the extent that pro-social motivation has been exhausted for COVID-19 vaccination, carrots such as incentives and sticks such as mandates have proven fruitful.
Pro-social motives have considerable potential as a useful tool to increase vaccination for many infectious diseases, such as seasonal influenza, HPV, and measles.
Data Availability
All data produced are available online at https://doi.org/10.17605/OSF.IO/K6WE2.
Funding statement
The Center on the Economics and Demography of Aging (NIH 2P30AG012839), University of California, Berkeley, provided funding.
Authorship contribution statement
Reddinger: Conceptualization, methodology, formal analysis, writing, project administration, software, validation, investigation, resources, data curation, visualization. Charness: Conceptualization, methodology, formal analysis, writing, project administration. Levine: Conceptualization, methodology, formal analysis, writing, project administration, funding acquisition.
Declaration of competing interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Appendix
Appendix A. Additional results
A.1. Additional specifications
Our primary analysis only considered vaccination attributed to a mandate at school or work. To preserve our degrees of freedom considering our sample size, we only included two co-variates, public-good game contribution and the predicted vaccination hazard rate.
We offer additional specifications in Table 3. We consider vaccination attributed to a mandate for travel or social events, in addition to those for school or work (Columns 5–8). We also include specifications with the subject’s political affiliation (Columns 2, 4, 6, and 8), to which our results are largely robust.
Additional Cox regressions of vaccination hazard (not attributed to a mandate)
A.2. Additional visualizations
Figure 3 graphically summarizes all of the participant data used in our analyses—the date of one’s first vaccine dose, one’s contribution in the public-good game, and whether one vaccinated due to a mandate.
Participant counts by first-dose date and public-good contribution
Appendix B. Robustness checks
B.1. Standard errors
We report a variety of other standard errors for the Cox regressions in Table 4, finding no significant differences.
Standard error comparison of Cox regressions of vaccination hazard (not attributed to a mandate)
B.2. Schoenfeld residuals
Analysis of Schoenfeld residuals test the proportional hazards assumption. We test whether proportionality of hazards varies with time by inspecting Schoenfeld residuals for Column 2 of Table 2, shown in Figure 4. We find no significant effect of time on hazard proportionality (, p = 0.72).
Schoenfeld residuals for the Cox regressions
B.3. Results using OLS with date-of-first-dose indicators
The hazard model of vaccination is the preferred specification, as it asserts that pro-social preferences influence vaccination uptake at any point in the time range of our study. We can, however, also check if being vaccinated by any particular point in time is predictive of pro-social preferences. As shown in Table 5, we find that individuals who vaccinate before most points in time contribute more in the public-good game.
OLS regressions using time-of-first-dose indicators
Appendix C. Competing hazards
Because vaccination attributed to a mandate and vaccination not attributed to a mandate are likely informative of each other, we also consider the subhazard distribution model of competing hazards from Fine and Gray (1999) (see also Kalfleisch and Prentice 2002). With this model, once an individual experiences the competing event, she is not entirely removed from the risk set for the primary event of interest. For example, if an individual was not mandated by an employer to become vaccinated, they may have eventually chosen to do so on their own accord. Then removing them entirely from the risk set of non-mandated vaccination will bias our estimates. Note that we may analyze non-mandated vaccination as the primary event of interest with mandated vaccination as the competing event; we may also analyze mandated vaccination with non-mandated vaccination competing.
For each competing event type k ∈ {1, 2} —non-mandated and mandated vaccination, respectively—we model the hazard of the corresponding subdistribution as
where γ0k (t j) is the baseline hazard of the sub-distribution of event type k. This estimation is similar to the Cox model, except that people who experience a competing event are underweighted instead of being removed entirely from the risk set.
Results from the Cox and competing hazards regressions can jointly reveal how counterfactual events may bias our estimates. For example, suppose that greater contribution in the public-good game is associated with greater voluntary first-dose hazard and also with greater mandated first-dose hazard. When we observe an individual with a high public-good-game contribution who becomes vaccinated without a mandate, we cannot observe what she would have done had she waited to vaccinate and then been given a mandate. Because the competing event (mandated vaccination) also has a positive association with contribution, we would underestimate the effect of pro-social preferences on mandated vaccination. We would also simultaneously underestimate the effect of pro-social preferences on mandated vaccination. These relationships depend on whether the effect of pro-social preferences has the same or the opposing direction regarding the risk of each event type. However, note that because we do not observe counterfactuals, we cannot completely eliminate bias.
C.1. Results
Column 1 of Table 6 shows results for vaccination not attributed to a mandate, treating vaccination attributed to a mandate as a competing event (and thus underweighting it). Likewise, Column 2 presents results on mandated vaccination with non-mandated vaccination competing. Figure 5 depicts the results for both types of events. An additional dollar contribution in the public-good game is associated with 12.5% greater daily hazard of vaccination not attributed to a mandate. The regression for vaccination attributed to a mandate is slightly underpowered; our intent was to study voluntary vaccination.
Competing vaccination hazards regressions
Regressions of competing vaccination events, non-mandated and mandated
Comparing the Cox and competing hazards results, we find that the Cox regressions are fairly unbiased from the censored individuals who vaccinate due to a mandate. Further, mandated vaccination generally lags non-mandated vaccination, as shown in Figure 5. As a result, censoring mandated vaccination has little impact on the Cox regression. We conclude that an additional dollar of public-good contribution is associated with 1.12 times higher hazard of non-mandated vaccination. Therefore, an individual who contributed the maximal amount of $4 has a 48% greater hazard of voluntary vaccination relative to an individual who contributed nothing.
Appendix D. Experimental instructions
D.1. Session I
This survey was administered using the Prolific.com account of Lucas Reddinger (UCSB affiliation). Respondents were given the contact information of Gary Charness (with a UCSB email address) in the consent form.
We titled our survey “Survey about COVID-19 vaccination.” Before giving informed consent, respondents were shown this information about the survey:
15 multiple-choice questions about your reasons for taking or not taking a COVID-19 vaccine.
15 multiple-choice demographic questions.
Estimated 5 minutes to complete.
$1.00 payment.
This survey is completely anonymous.
We solicited the following: COVID-19 vaccination status; if vaccinated, type of vaccine received; if applicable, intent to receive the second dose; if applicable, intent to receive a first dose; if applicable, date of first dose. We also asked, “Did you get vaccinated because it would be mandatory or required for you somehow? (Choose all that apply.) □ Yes, for work; □ Yes, for school; □ Yes, for travel; □ Yes, for social events or restaurants; □ No, none of these.”
D.2. Session II
This survey was administered using the Prolific.com account of David Levine (UC Berkeley affiliation). Respondents were given the contact information of David Levine (with a UC Berkeley email address) in the consent form.
We titled our survey “Survey about decision-making.” Subjects earned $1 for participating, in addition to any bonus that resulted from the games. Bonus payments were promised (and paid) within 24 hours.
Respondents were shown a series of slides that explained our public-good game. Three example slides from the series are shown in Figure 6. Respondents were then shown these instructions:
Three example instructional slides used in Session II
You will be matched with three other participants who each made their own decision of how much to put in the pot.
Each person’s bonus is determined by the decisions of all four participants.
□ Put nothing into the pot. Keep all $4 to myself.
□ Put $0.50 into the pot. Keep $3.50 to myself.
□ Put $1.00 into the pot. Keep $3.00 to myself.
□ Put $1.50 into the pot. Keep $2.50 to myself.
□ Put $2.00 into the pot. Keep $2.00 to myself.
□ Put $2.50 into the pot. Keep $1.50 to myself.
□ Put $3.00 into the pot. Keep $1.00 to myself.
□ Put $3.50 into the pot. Keep $0.50 to myself.
□ Put $4.00 into the pot. Keep nothing to myself.
Footnotes
Broadened scope of applications. Added additional specifications and robustness checks.
↵4 Lab-in-the-field studies in the economics literature use similar methods (Gneezy and Imas 2017).
↵5 Thus our study naturally omits many of age 65 or with health problems who qualified for early vaccination.
↵6 We consider attainment of a first dose rather than the completion of the entire vaccine series, because the number of doses in the series depends on the vaccine.
↵7 While our primary results only include mandates at school or work, Appendix A.1 offers similar results that also censor individuals who vaccinate due to a mandate for travel, social events, or restaurants.
↵8 While the Cox model is standard, we do conduct robustness checks using OLS that are reported in Appendix B.3.
↵9 The University of California, Santa Barbara, Human Subjects Committee exempted our Protocol 60-20-0658. We obtained informed consent from all participants. We pre-registered our study with the American Economic Association as AEARCTR-0008216 (Reddinger, Charness, and Levine 2021). We use Stata 17 for analysis. Reddinger, Charness, and Levine (2022) provide data and source code.
↵10 The party breakdown of mandatory vaccination is interesting: 25.5% of vaccinated Republicans, but only 11.4% of Democrats and 14.5% of the remainder, said they vaccinated due to a mandate. We also ask unvaccinated respondents whether they would take the vaccine if it were mandatory, but we do not use these speculative responses in our analyses. With that caution in mind, when asked if they would comply with a vaccination mandate, 53.1% of Democrats responded “Yes”, while only 22.7% of Republicans and 26.6% of others stated they would comply.
↵11 As per our pre-registration materials, we do ask about behavior in other games, but never intended these games to be measures of pro-sociality. The public-good game would seem to be the clear best match for a field environment where all participants contribute to public safety and welfare by getting vaccinated.
↵12 Robustness checks are presented in Appendix B.
↵13 We collapse the covariates into the lasso prediction to preserve degrees of freedom given our sample size. Moreover, the components are not individually meaningful in our context.
↵14 Campos-Mercade et al. (2021a) find that a $24-equivalent incentive increased vaccination by 4.2 p.p. (baseline 71.6%) in Sweden. Barber and West (2022) find that Ohio’s conditional cash lotteries increased the vaccination rate by 0.7 p.p. (baseline 46.5%). But Chang et al. (2021) find no effect of a $10 or $50 incentive among Medicaid plan members in California who delayed vaccination. Further, Serra-Garcia and Szech (2021) find that low monetary incentives ($10–$20) decrease vaccination, while high incentives ($100) increase vaccination. Clearly the success of monetary incentive programs depends on many factors, including the targeted population and the level of monetary incentives.