Abstract
We analyze COVID-19 vaccine acceptance across 15 survey samples covering ten low- and middle-income countries (LMICs) in Asia, Africa, and South America, Russia (an upper-middle-income country), and the United States, using survey responses from 44,260 individuals. We find considerably higher willingness to take a COVID-19 vaccine in LMIC samples (80% on average) compared to the United States (65%) and Russia (30%). Vaccine acceptance was primarily explained by an interest in personal protection against COVID-19, while concern about side effects was the most commonly expressed reason for reluctance. Health workers were the most trusted sources of information about COVID-19 vaccines. Our findings suggest that prioritizing vaccine distribution to LMICs should yield high returns in promoting global immunization coverage, and that vaccination campaigns in these countries should focus on translating acceptance into uptake. Messaging highlighting vaccine efficacy and safety, delivered by healthcare workers, may be most effective in addressing remaining hesitancy.
A safe and effective vaccine against COVID-19 is a critical tool to control the pandemic. As of April 27, 2021, 22 vaccines had advanced to Stage 3 clinical trials1 and more than a dozen vaccines had been approved in multiple countries2. For example, as of April 27, 2021, Comirnaty (BioN-Tech/Pfizer) had been approved in more than 80 countries, while the AstraZeneca vaccine had the most country authorizations at 92.2 At present, however, global vaccine distribution remains highly unequal, with much of the current supply directed toward high-income countries.3
While effective and equitable distribution of COVID-19 vaccines is a key policy priority, ensuring the population’s acceptance is equally important. Trust in vaccines and the institutions that administer them are key determinants of the success of any vaccination campaign.4 Several studies have investigated willingness to take a potential COVID-19 vaccine in high-income countries,5–10 and some studies have included middle-income countries.3, 11 Less is known, however, about vaccine acceptance in low-income countries where large-scale vaccination has yet to begin. Understanding the drivers of COVID-19 vaccine acceptance is of global concern, since a lag in vaccination in any country may result in the emergence and spread of new variants that can overcome vaccine- and prior disease-conferred immunity.12, 13
Our study complements the emerging global picture of COVID-19 vaccine acceptance by focusing primarily on lower income countries. We construct a sample of low- and middle-income countries (LMICs) with wide geographic coverage across Africa, Asia and Latin America. We move beyond documenting vaccine acceptance rates and analyze data on the reasons for acceptance and hesitancy, which is critical for informing the design of effective vaccine distribution and messaging.
Acceptance of childhood vaccination for common diseases—such as measles (MCV), Bacille Calmette-Guérin (BCG) and diphtheria, tetanus, and pertussis (DTP)—is generally high in LMICs, providing cause for optimism about the prospects for COVID-19 vaccine uptake. Table 1 summarizes general vaccine acceptance and coverage rates of childhood vaccines in 2018, prior to the current pandemic, for the countries included in our study. Agreement on the importance of childhood vaccinations is markedly higher in these LMICs compared to Russia and the United States. Still, existing studies on COVID-19 vaccine acceptance document substantial variation, both across and within countries, including in settings with high background levels of other vaccinations.3, 4, 11
This literature cites concerns about COVID-19 vaccine safety, including concerns about the rapid pace of vaccine development, as reasons for hesitancy in higher-income settings,3, 5 but other reasons may feature more prominently in LMICs. For instance, reported COVID-19 mortality rates have been consistently lower in LMICs relative to higher income countries.14 If individuals feel the risk of disease is less serious, they may be less willing to accept any perceived risks of vaccination.15 Previous studies of healthcare utilization in LMICs have also highlighted factors such as healthcare quality concerns,16 negative historical experiences involving foreign actors,17, 18 weak support from traditional leaders,19 and mistrust in government20 as barriers to uptake, which could apply to COVID-19 vaccination as well.
To promote vaccination against COVID-19 and develop effective messaging strategies, we need to know whether people are willing to take COVID-19 vaccines, the reasons why they are willing or unwilling to do so, and the most trusted sources in their decision-making. Our study investigates these questions using a common set of survey items deployed across 13 studies in Africa, South Asia, and Latin America: seven in low-income countries (Burkina Faso, Mozambique, Rwanda, Sierra Leone, Uganda), five in lower-middle-income countries (India, Nepal, Nigeria, Pakistan), and one in an upper-middle-income country (Colombia). We compare these findings to those from two countries at the forefront of vaccine research and development, Russia and the United States. To select studies to include in our sample, we conducted an internal search within Innovations for Poverty Action (IPA), the International Growth Center (IGC), and the Berlin Social Science Center (WZB) for projects with plans to collect survey data in the second half of 2020. Study PIs agreed to include a set of common questions about COVID-19 vaccine attitudes. This strategy was guided by the need to collect information quickly and cost effectively using a survey modality (phone) that was both safe given pandemic conditions and appropriate for contexts with limited internet coverage. The final set of samples included in our study therefore reflects populations that fall under the current research priorities at IGC, IPA and WZB and, in the case of IPA and IGC, donors that prioritize working in the Global South.
Results
Our main results are shown in Figure 1 and reproduced as Appendix A Table 4. The first column provides overall acceptance rates in each study, while the remaining columns disaggregate acceptance rates by respondent characteristics. The “All LMICs” row reports averages for LMIC countries and excludes Russia and the USA.
We document meaningful variation in vaccine acceptance across and within LMICs, but generally high levels of acceptance in LMICs overall. The average acceptance rate across studies was 80.3% (95% CI 74.9–85.6%), with a median of 78, a range of 30.1 percent points and an interquartile range of 9.7. Our estimate of τ2 is 0.007 which implies a standard deviation over country averages of 0.084.
The acceptance rate in every LMIC sample was higher than in the USA (64.6%, 61.8–67.3%) and Russia (30.4%, 29.1–31.7%). Reported acceptance was lowest in Burkina Faso (66.5% 63.5– 69.5%) and Pakistan 2 (66.5%, 64.1–68.9%). The case of Pakistan may be linked to negative historical experiences with foreign-led vaccination campaigns.21, 22 This hesitancy may be particularly problematic, given the magnitude of the second wave in neighboring India just as vaccines are becoming available, with accelerating cases in Bangladesh, Pakistan and India threatening to overwhelm health infrastructure.
We find limited evidence of variation across demographic subgroups in our LMIC samples, as shown in Appendix A Table 9. Women were generally less willing to accept the vaccine (average difference about 4.2 points, significant at p < .01). Respondents under age 24 and less educated respondents were marginally more willing to take the vaccine, but these differences were not statistically significant. The acceptance advantage among the less educated was most pronounced in Rwanda, Burkina Faso, and Uganda, and stands in contrast to the USA, where more educated respondents were significantly more willing to be vaccinated.
To better understand the reasoning behind vaccine acceptance, we asked those who were willing to take the vaccine why they would take it. We summarize these results in Table 3, with additional details in Appendix A Table 5. The reason most commonly given for vaccine acceptance across samples was personal protection against COVID-19 infection. The average across the LMIC samples was 91% (86–96%). In every individual study, this ranked as the most popular reason. In distant second place among LMIC respondents was family protection with an average of 36% (28– 43%). In comparison to protecting oneself and one’s family, protecting one’s community did not feature prominently among stated reasons for acceptance. These reasons do not vary substantially by age group, as shown in Table 11. Self-protection also ranked as the most common reason for taking the vaccine in Russia (76%, 74–78%) and the USA (94%, 92–95%).
Figure 2 summarizes the reasons given by respondents who said they were not willing to take a COVID-19 vaccine. Concern about side effects was the most frequently expressed reason for reluctance in our LMIC samples. This concern was particularly evident among African country samples. In studies Uganda 1 (85.1% 80.7–89.6%), Sierra Leone 2 (57.9%, 50.1–65.7%), Sierra Leone 1 (53.5% 47.1–59.9%) and Uganda 2 (47.3% 42.2–52.5%), more than half of respondents unwilling to take the vaccine cited worries about side effects. Respondents in Russia (36.8%, 35.2– 38.4%) and even more in the USA (79.3%, 74.6–84%), frequently reported this same concern.
Study samples Uganda 2 (31%, 25.9–36.2%), Mozambique (29.7%, 18.6–40.8%) and Pakistan 1 (26%, 18–34%) showed relatively high levels of skepticism about vaccine effectiveness among hesitant respondents. This was also true in Russia (29.6%, 28.1–31.1%) and the USA (46.8%, 41–52.6%). In addition, hesitant respondents listed lack of concern about COVID-19 infection as a reason not to be vaccinated. Study samples USA (39.3% 33.5–45%), Pakistan 1 (29.4%, 20.9–37.9%) and Nepal (20.4% 6.7–34.1%) reported high rates of this answer among hesitant respondents.
In Figure 3 we report respondents’ most trusted source of guidance when deciding whether to take a COVID-19 vaccine. Results from Figure 3 are reproduced as Appendix A Table 8. Appendix B Table 15 presents a complete description of response recoding from individual studies.
We find striking consistency in most trusted sources across studies. In all but one sample, including those from Russia and the USA, respondents identified the health system as the most trustworthy source to help them decide whether to take the COVID-19 vaccine. The average across LMICs was 48.1% (31.6–64.5%). Respondents in Sierra Leone 2 (89.3%, 87.2–91.5%), Nigeria (58%, 55.7– 60.2%) and Burkina Faso (51.6%, 48.5–54.8%) cited health workers most often. Sierra Leone had the highest trust in health workers and the Ministry of Health, potentially due to investments in public health following the 2014-2015 Ebola epidemic.23
The next most cited sources were family and/or friends in Colombia (36.6%, 33.5–39.7%), Nepal (35.6%, 32.9–38.3%), Russia (28.1%, 26.8–29.3%) and Burkina Faso (18.4%, 16–20.9%). Across the pooled samples, women were 3 percentage points more likely to rely on family and friends than male respondents, though this difference was not statistically significant (Figure 5 in Appendix D).
By contrast, in Sierra Leone 1 (32.5%, 29.7–35.4%), Uganda 2 (32.4%, 29.9–35%), USA (29.7%, 27–32.3%) and Nigeria (18%, 16.2–19.8%), government was the second most frequently cited. Religious leaders and celebrities were not seen as the top sources of guidance by many respondents in any sample other than Nepal, where many respondents most trusted famous people (16.1%, 13.3–18.9%).
Finally, we highlight two idiosyncratic, yet frequently mentioned, trusted sources of information in deciding whether to take a COVID-19 vaccine. In Rwanda, 34% of respondents would most trust “themselves” for guidance, the most frequent response in this sample. In the USA, 14% of respondents cited Joe Biden, then president-elect and therefore excluded from the “government” category, as their most trusted source.
Discussion
To our knowledge, this is the first study focusing on COVID-19 vaccine attitudes in a large set of low-income and lower-middle-income countries. Our findings showed variable but broadly high levels of prospective COVID-19 vaccine acceptance across LMICs, using data from 44,260 respondents in 13 studies in ten LMICs in Africa, South Asia, and Latin America. Acceptance across these LMIC samples averaged 80.3%, ranging between 66.5% and 96.6%. The two benchmark countries, Russia and the USA, demonstrated lower COVID-19 vaccine acceptance, consistent with relatively lower pre-pandemic vaccine confidence.
Many metrics and indices measure vaccine acceptance and hesitancy globally.24–26, 27, Our surveys used measures employed in other COVID-19 vaccine acceptance studies3, 6–11 and recommended by the WHO Data for Action guidance,28 allowing for meaningful cross-study and cross-country comparisons. We measure trust in sources of information about COVID-19 vaccination using a measure similar to that used in the Vaccine Confidence Index (VCI), a widely used survey tool.4
Consistent with other studies, we find higher vaccine acceptance among men than women.3, 7–10 In contrast to studies focused primarily on higher-income countries, we find no consistently significant differences with respect to age7, 9 or education in our LMIC samples.
A key contribution of our study relative to the previous literature is its focus on the reasons why respondents express intentions to take (or refuse) a COVID-19 vaccine. Other work has highlighted appeals to altruistic behavior or other prosocial motivations to promote vaccine acceptance.29 Yet we find that the potential risks and benefits to personal well-being feature much more prominently in our respondents’ reasoning, suggesting that appeals about personal protection may be more effective in LMICs.
The most commonly stated reason for vaccine refusal was concern about safety (side effects). Around 86% of our surveys were conducted as reports from Phase 2 and 3 clinical trial data were emerging for the earliest commercially available vaccines, but prior to the first Emergency Use Authorization of any vaccine (Pfizer-BioNTech approved by the USA on December 11, 2020). Early trial data showed that severe adverse effects were extremely rare,30–35 occurring in fewer than 10% of people in clinical trials.36 Our respondents’ outsized concern about side effects could reflect the rapid pace of vaccine development,37 and limited information available about potential COVID-19 vaccine safety at the time of data collection. These concerns could also reflect worries about mild, yet common and transient side effects, such as fatigue, muscle pain, joint pain and headache.
Prominent media coverage of adverse events may exacerbate concerns about side effects.38 In particular, new information about rare but severe cases of thrombosis associated with the Astra-Zeneca vaccine that appeared after our data collection period could affect hesitancy levels. This is of particular relevance to LMICs, which are likely to rely on the Astra-Zeneca vaccine in their immunization campaigns, through initiatives such as COVAX.
Concerns about vaccine efficacy, averaging approximately 19.2% in the LMIC samples, may also reflect a lack of information about vaccines at the time of our surveys. Strikingly, even in low-information environments, respondents in our samples rarely cited conspiracy theories about ulterior motives on the part of corporations, politicians or the pharmaceutical industry, despite widespread popular fears about these issues in higher-income countries.39
An important limitation of our study is that our samples are not fully nationally representative. Phone surveys, while necessary during a global pandemic, do not include individuals who reside outside coverage areas, lack access to a cell phone, or do not respond to calls. In addition, as shown in Table 2, several studies focus on sub-populations of interest in pre-existing studies to which questions about COVID-19 vaccination were added. Particular care should be taken in any attempt to extrapolate to the national population level from these samples. Furthermore, we emphasize that our data are not representative of all LMICs. They represent a convenience sample of studies in countries in which our organizations could quickly mobilize coordinated data collection.
The expressed intentions to take a COVID-19 vaccine that we document in our LMIC samples, if translated into behavior, would meet or exceed the current herd immunity threshold for COVID-19 (estimated at 60-80%, based on the predominant variant in circulation in these countries).40–42 However, reported intent may not always convert vaccine uptake.43 The high salience of COVID-19 due to extensive media coverage may have increased reported intentions. Conversely, reports about side effects and risks associated with expedited vaccine development may have increased hesitancy. The fast-moving pandemic and vaccine development context may change perceptions about vaccines by the time they are widely available in LMICs.
Indeed, previous research on vaccine hesitancy has emphasized how concerns that arise surrounding vaccination campaigns are often case- and context-specific,44 making it difficult to predict exactly how COVID-19 vaccines will be received in any given setting. The lower COVID-19 vaccine acceptance rates we observe in Russia and the USA, for example, may reflect the politicization of this specific pandemic and vaccine development,45–48 in addition to generally greater vaccine skepticism.
Nonetheless, our findings suggest several concrete implications for policy relating to vaccine roll-out in LMICs. First and foremost, we document high levels of COVID-19 vaccine acceptance in LMICs compared to Russia and the USA. While global vaccine distribution has skewed heavily toward higher-income countries to date,3 our findings suggest that prioritizing distribution to LMICs is justified not only on equity grounds, but on the expectation of “better value” in maximizing global coverage more quickly.
Our findings also imply that, once vaccine distribution to LMICs begins in earnest, interventions should focus on converting positive intentions into action. Straightforward, low-cost nudges may be particularly effective in this regard. Two recent large-scale studies in the USA found that vaccination appointment reminder messages from healthcare providers increased influenza vaccine uptake.49, 50 Similar interventions have proven effective in increasing immunization in LMIC contexts. In Ghana and Kenya, vaccination reminders plus small cash incentives increased childhood immunization coverage.51, 52 Cash and in-kind incentives programs were also effective in Nigeria and India.53, 54
This recommendation is consistent with accepted frameworks, such as the WHO’s Behavioral and Social Drivers of vaccination (BeSD) model, which suggests leveraging favorable intentions through reminders and primes, and reducing access barriers when the vast majority of people intend to be vaccinated.28, 55 Particularly since COVID-19 vaccination may be more collectively than individually optimal, ease of access is critical to achieve high coverage.56
Our findings also suggest directions for the design and delivery of messaging to boost COVID-19 vaccine acceptance and uptake in LMICs. We highlight four potential implications. First, our data strongly support the view that respondents from LMICs prefer to follow the guidance of actors with the most relevant knowledge and expertise. We find high levels of trust in health workers, which suggests that social and behavioral change communication (SBCC) strategies engaging local health workers may be particularly effective in encouraging efficient and comprehensive vaccine uptake and combating remaining hesitancy.46, 57 Health workers have been the first group to receive the COVID-19 vaccine and are therefore best-positioned to share locally credible experiences of vaccination.58 While celebrities were not identified as a particularly trustworthy source for COVID-19 advice in our study, celebrity endorsements have proven effective in other contexts and may complement a strategy that primarily focuses on health workers.59
Second, our findings offer guidance on the specific content of vaccine messaging that is likely to be most persuasive. Hesitant respondents were most concerned about side effects and vaccine efficacy. This suggests that messaging should highlight the high efficacy rates of the COVID-19 vaccines currently on the market in reducing or eliminating disease, hospitalizations, and death, and communicate accurate information about potential side effects. Our data also suggest that messaging should emphasize the direct protective benefits of the vaccine to the adopter, since personal protection, rather than broader concerns about protecting public health, was the top reason expressed for vaccine-acceptance by our respondents.
Third, consistent with previous studies on COVID-19 vaccination3, 7–10 our study finds lower vaccine acceptance among women than men, suggesting that messaging strategies should focus on women. Recent work in Latin America on COVID-19 vaccine messaging found that the provision of basic information about the vaccines was particularly effective in persuading hesitant women.60
Finally, high coverage rates of existing vaccines, coupled with respondents’ reliance on friends and family as information sources, suggest that the general pro-vaccination stance of many LMIC citizens could be leveraged to increase uptake of COVID-19 vaccines as they become available. Social learning strategies and norm-setting are powerful drivers of behavior in many related sectors.61 Social signaling of positive attitudes toward and uptake of COVID-19 vaccines may also help shift social norms toward even greater immunization acceptance and two-dose completion in the community at large.62
Methods
Survey questions and sample construction
Survey data were collected between June 2020 and January 2021. Our main outcome measure is vaccine acceptance. Across studies, we asked respondents, “If a COVID-19 vaccine becomes available in [your country], would you take it?”. This measure aligns with widely reported COVID-19 vaccine acceptance measures.3, 6–11 If the respondent answered yes to this question, we followed up with the question, “Why would you take it? [the COVID-19 vaccine]”. If the respondent said they would not be willing to take the vaccine, we followed up with the question, “Why would you not take it? [the COVID-19 vaccine]”. Finally, regardless of their expressed willingness to take the vaccine, we asked about actors and institutions that would be most influential in their decision: “Which of the following people would you trust MOST to help you decide whether you would get a COVID-19 vaccine, if one becomes available?” following.4 To examine heterogeneity across demographic strata, we collected information about gender, age, and education. Slight variations in question wording and answer options across studies are documented in Appendix B.
Studies vary in terms of geographic scope, sampling methodology, and survey modality. Seven were national or nearly-national in scope. Studies from Burkina Faso, Colombia, Rwanda, and Sierra Leone (“Sierra Leone 1”) used nationally-representative samples of active mobile phone numbers reached through Random Digit Dialing (RDD). Studies in the USA and Russia were conducted online using quota samples obtained from private survey companies.
The remaining eight studies targeted sub-national populations. One study from Pakistan (“Pakistan 2”) used RDD in Punjab province. Respondents in Mozambique, Nigeria, Pakistan (“Pakistan 1”), Uganda (“Uganda 1”,“Uganda 2”), India, Nepal and Sierra Leone (“Sierra Leone 2”) were drawn from pre-existing studies to which COVID-19 vaccine questions were subsequently added. For example, Sierra Leone 2 has national coverage from a study on access to electricity and Uganda 1 sampled female caregivers of households in rural and semi-rural villages as part of a large ongoing cluster-RCT implemented across 13 districts.
Table 2 in Appendix A summarizes the geographic scope, sampling methodologies and survey modalities of all 15 studies. A detailed description of each study is included in Appendix C.
All surveys were conducted remotely to minimize in-person contact and comply with social distancing guidelines. Interviews were conducted by local staff in each country in local language(s). Surveying by phone made rapid, large-scale data collection possible. In two samples, the USA and Russia, surveys occurred via online polling. All surveys lasted approximately 15 to 40 minutes.
Taken together, we have data from 20,176 individuals from 10 LMICs and 24,084 from the USA and Russia, for a total of 44,260 respondents.
Statistical Analysis
Vaccine acceptance was defined as the percentage of respondents who answered “yes” to the question, “If a COVID-19 vaccine becomes available in [country], would you take it?”. This was calculated combining all other answer options (“No”, “Don’t Know” and “Refuse”) into a single reference category. We estimated average acceptance for each individual sample via ordinary least squares (OLS) weighted by respective study population weights and robust standard errors clustered at the level relevant for the sample.
In addition to study-level estimates, we combined data from all studies other than the USA and Russia to calculate an aggregate “All LMIC studies” estimate. For these analyses, we estimated average acceptance by OLS with weights for each study normalized such that the total weight given to observations was constant across studies. Robust standard errors for these analyses were clustered at the study level.
We note the core results would be virtually unchanged at 80.8% (74.5–87.1) rather than 80.3% (74.9 -85.6) using countries rather than studies as groups in the pooled analysis, that is if we set weights so that the sum of weights in each country (rather than in each study) sum to a constant and cluster standard errors at the country level (rather than the study level).
In this combined analysis, we also estimated the underlying heterogeneity of vaccine acceptance across studies using the between studies variance estimator τ2 from a random effects model.
We conducted subgroup analyses by gender, age and education level and reported differences between groups. For age, we selected cut-offs below 25, between age 25 and 54, and above 55 years old, closely following the age breakdown proposed by recent work on COVID-19 vaccine acceptance.11 However, the lower life expectancy (63 years on average)63 and younger-skewing populations (only 5% of the population is above 65 years old)64 of low-income countries in particular, precluded further disaggregation at the upper end of the age distribution. For education, we divided the sample between respondents who had completed secondary school and those that had not. We defined these two groups to reflect broader schooling trends in LMICs, where out of every 100 students entering primary education, 61% complete lower secondary education.65 The subgroup analyses estimates are calculated in exactly the same way as the overall acceptance rate—with weights again normalized to sum to a constant within each study—with the exception that the subsample used in the analysis is limited to those respondents fitting each demographic group.
We then investigated stated reasons for COVID-19 vaccine acceptance and hesitancy, and the types of actors respondents would trust most when making the decision about whether to take a COVID-19 vaccine. We report estimates of agreement with reasons for vaccine acceptance/hesitancy and trust in actors for individual studies and for the “All LMICs” group, which includes all study samples except Russia and the USA. Estimates were calculated with the same procedure as above, varying only the quantity of interest; i.e. one model is run for each reason why a respondent would (or would not) take the vaccine and each trusted actor.
Data Availability Statement
Individual participant data (de-identified) that underlie the results reported in this article, are available without restrictions at https://github.com/wzb-ipi/covid_vaccines_nmed.
Code Availability
All code has been deposited into the publicly available GitHub repository at https://github.com/wzb-ipi/covid_vaccines_nmed. The code and output for all analyses can be easily inspected at https://wzb-ipi.github.io/covid_vaccines_nmed/replication.html.
Data Availability
Code and output of the analysis can be consulted here https://wzb-ipi.github.io/covid_vaccines/replication.html.
Contributors
JSo, SW, NMe, AS, NMc, GS, MV and AM are co-first authors. DK, MC, MT, MH, AMM and SO are co-last authors. AMM and SO are also the corresponding authors. DK, AMM, MT, NMe, MC, and MV conceived of the study and provided overall guidance. SAb and NMe led the literature search, with input from AS, NMc, SW, AMM, AM and JSo. SW, NMe, AS, NMc, MV, GS, AA, SA, BA, AB, EB, CMB, AC, EC, MF, AG, AK, SK, RL, MBN, MP, JSh, JSv, PV, LB, BZ, MC, SAs, AC, AF, AH, MC, MT, and MH oversaw data collection as part of other research efforts. SW, NMe, and MT coordinated the project across study samples. The following verified the underlying data for individual study samples: EC (Burkina Faso, Colombia, Rwanda, Sierra Leone 1), BA and AB (India), AS and RL (Nigeria), AG, JSv and MBN (Uganda 1), CMB and MH (Uganda 2), NMe and MV (Sierra Leone 2), GS (Russia), MF (Mozambique), AF and JSh (Pakistan 1), SAs (Pakistan 2), CV (Nepal), and NMc (USA). JSo, GS, MH and SA collated and processed all datasets used for the analysis. NMe, MH, AMM, JSo, GS, SW, AS, EC, EB, MT, MV and NMc did the data interpretation with guidance from SO and AM. JSo, GS, EC and MH verified final datasets and analysis. JSo and GS did the data analysis and produced output figures with input from MH, AMM, DK, SW, EC, MV, NMe and MT. MH supervised the data analysis. JSo, SW, NMe, AMM, AS, NMc and MV wrote the first draft of the manuscript, with guidance from AM and SO. JSo, SW, NMe, AS, NMc, MV, SAb, EB, MP, JSh, PV, BZ, MC, MT, MH, AMM and SO revised the manuscript. All authors approved the final version of the manuscript. All authors had full access to all the data used in this study and had final responsibility for the decision to submit for publication.
Funding
Funding was provided by Beyond Conflict, Bill and Melinda Gates Foundation, Columbia University, Givewell.org, Ghent University, HSE University Basic Research Program, International Growth Centre, Jameel Poverty Action Lab Crime and Violence Initiative, London School of Economics and Political Science, Mulago Foundation, NOVAFRICA at the Nova School of Business and Economics, NYU Abu Dhabi, Oxford Policy Management, Princeton University, Social Science Research Council, Trinity College Dublin COVID19 Response Funding, UK Aid, UKRI GCRF/Newton Fund, United Nations Office for Project Services, Weiss Family Fund, WZB Berlin Social Science Center, Yale Institute for Global Health, Yale Macmillan Center, and anonymous donors to IPA and Y-RISE.
Role of the funding source
None of our funders played any role in the collection, analysis, interpretation, writing or decision to submit this article for publication.
Declaration of interests
We declare no competing interests.
Acknowledgements
This work would not have been possible without the hard work and ingenuity of many. For valuable contributions to data collection during the challenging context of the global pandemic, we would like to thank:
Burkina Faso: Béchir Wendemi Ouédraogo (M&E Associate), Achille Mignondo Tchibozo (Research Manager) and Touba Bakary Pare (Senior Field Manager) at IPA Burkina Faso in Ouagadougou for their work on the RECOVR (Research for Effective Covid Response) survey from which the questions used in this study were drawn.
Colombia: Margarita Rosa Cabra Gacia (Senior Research Associate), Laura Polanco, María Juliana Otálora (Research Analyst), Sofía Jaramillo (Research Manager) and Mery Galindo (Field Coordinator) at IPA Colombia in Bogotá for their work on the RECOVR (Research for Effective Covid Response) survey from which the questions used in this study were drawn.
India: Bhartendu Trivedi, Yashashvi Singh, Tatheer Fatima and the field team of Morsel Research and Development.
Mozambique: Alberto Arlindo, Imamo Mussa, Ismail Mussa, Frederica Mendonça and Simão Paiva from NOVAFRICA Mozambique office.
Nepal: Arjun Kharel and field staff at the Centre for the Study of Labour and Mobility (CESLAM) in Kathmandu.
Nigeria: Opeyemi Adeojo (Department of Sociology, University of Lagos), Deborah Anigo, Isaac Obara, Segun Fayomi, and Aishwarya Kumar at the Busara Center for Behavioral Economics, and Sarah Ryan (University of Illinois at Chicago) for research assistance.
Pakistan 1: Ahsan Tariq and Shan e Muhammad Malik at the Institute for Development and Economic Alternatives (IDEAS) in Lahore as survey wing leads and Hamid Ali Tiwana for research assistance.
Pakistan 2: Staff and the internal survey firm at the Centre for Economic Research Pakistan (CERP).
Rwanda: Jean Leodomir Habarimana Mfura (Research and Policy Coordinator), Jean Aime Nsabimana and Gisele Manirabaruta (Field Manager) at IPA Rwanda in Kigali for their work on the RECOVR (Research for Effective Covid Response) survey from which the questions used in this study were drawn.
Russia: Staff at Online Market Intelligence Survey Agency, Kirill Chmel (HSE University) and Vladimir Zabolotsky (HSE University and University of Bologna) for their intellectual contributions and research assistance.
Sierra Leone 1: Filippo Cuccaro (Research Coordinator) and Fatoma Momoh (Senior Field Manager) at IPA Sierra Leone in Freetown for their work on the RECOVR (Research for Effective Covid Response) survey from which the questions used in this study were drawn.
Sierra Leone 2: Sellu Kallon (Field Manager), Junisa Nabieu (Field Supervisor), Momoh Flee (Field Supervisor), Hamid Kai, Mohamed Lamin (Field Supervisor) and all enumerators at IGC-Sierra Leone Freetown office and Wageningen University’s Project “Tracking the Economic Consequences of COVID-19 in Sierra Leone”.
Uganda 1: Staff at IPA Uganda, especially Sarene Shaked and Gloria Ayesiga, for their intellectual contributions, research assistance, and support throughout the Uganda 1 study.
Uganda 2: Co-PIs Ana Garcia Hernandez, Leah Rosenzweig, Lily Tsai, and Elly Atuhumuza, Martin Atyera, and their team of survey enumerators and support staff at IPA Uganda.
United States: Staff at Lucid (survey firm) for distributing the survey and providing the online survey sample.
IGC thanks their resident country teams in Sierra Leone, Uganda, Pakistan, and Mozambique for their continued guidance, coordination of activities with researchers and direct engagement and dissemination activities with national policymakers:
Herbert McLeod (Country Director) and Abou Bakarr Kamara (Country Economist) at IGC Sierra Leone
Richard Newfarmer (Country Director), Priya Manwaring (Country Economist), and Jakob Rauschendorfer (Country Economist) at IGC - Uganda
Ijaz Nabi (Country Director), Hina Shaikh (Country Economist), and Usman Naeem (Country Economist) at IGC - Pakistan
Claudio Frischtak (Country Director) and Egas Daniel (Country Economist) at IGC - Mozambique
IPA thanks staff from its global offices for their research assistance and support throughout the RECOVR survey. Hugo Salas (IPA Mexico) contributed to data analysis for Burkina Faso, Rwanda and Sierra Leone. Margarita Rosa Cabra Garcia also contributed to data analysis for Colombia. At IPA New York and Washington, DC, Michael Rosenbaum and Savanna Henderson provided research assistance.
NOVAFRICA thanks Cátia Batista (NOVA SBE), Sandra Sequeira (LSE) and Inês Vilela (Royal Holloway, University of London and NOVAFRICA) for their intellectual contributions.
Centre for Economic Research Pakistan (CERP) thanks Javaeria Qureshi (University of Illinois Chicago), Taimur Shah (CERP), and Basit Zafar (University of Michigan) for their contributions to the Economic Vulnerability Assessment (EVA) project from which the questions used in the Pakistan 2 study were drawn.
Appendix A: Supplementary tables, figures and results
Appendix B: Question wording and answer options per study
Appendix C: Sample descriptions
The case history data for all countries in our sample is extracted from the Johns Hopkins University Center for Systems Science and Engineering (JHU CSSE) database.1
Burkina Faso, Research for Effective COVID-19 Responses (RECOVR) National RDD Sample, Innovations for Poverty Action (IPA)
COVID-19 Experience
First confirmed case: March 9, 2020
Number of confirmed cases 2,335 as of October 15, 2020
Number of deaths: 65 as of October 15, 2020
Target Population
A random sample of all adults with mobile phone numbers in the country, based on national communications authority number allocation plans.
Original Study Design
N/A
COVID-19 Survey Design
Numbers were called via random digit dialing (RDD), stratified by mobile network operator market share for a two-round panel survey.
Sampling Frame: All mobile phone numbers in Burkina Faso.
Survey Dates: October 15 to December 4, 2020 (Round 1 June 6-15, 2020)
Sample size, tracking and attrition: Sample includes 977 respondents from the second round of a panel. In the first round conducted between June 6 to 15, 2020, 1,356 individual surveys were contacted through Random Digit Dialing (RDD) from the sampling frame of all mobile phone numbers in Burkina Faso. 2,313 working numbers yielded 1,383 eligible respondents for a completion rate of 98% of eligible respondents.
Sampling Weights: Post-stratification weights are computed to adjust for differential attrition between the first and second rounds of the RDD panel, weighting on gender, region, and educational attainment.
IRB Approval: This research was approved via IPA IRB Protocol 15608, and the Burkina Faso Institutional Ethics Committee for Health Sciences Research, approval A13-2020.
Colombia, Research for Effective COVID-19 Responses (RECOVR) National RDD Sample, Innovations for Poverty Action (IPA)
COVID-19 Experience
First confirmed case: March 6, 2020
Number of confirmed cases: 456,689 as of August 15, 2020
Number of deaths: 14,810 as of August 15, 2020
Target Population
A random sample of all numerically possible mobile phone numbers in the country, based on national communications authority number allocation plans.
Original Study Design
N/A
COVID-19 Survey Design
Sampling Frame: Numbers were called via random digit dialing (RDD), stratified by mobile network operator market share.
Survey Dates: August 15-25, 2020 (Round 1 May 8-15, 2020)
Sample size, tracking and attrition: Sample includes 1,012 respondents contacted in the second round of a panel of 1,507.
Sampling Weights: Post-stratification weights are computed to adjust for differential attrition between the first and second rounds of the RDD panel, weighting on gender, region, and educational attainment.
IRB Approval: This research was approved via IPA IRB Protocol 15582.
India, Coping with COVID-19 in Slums: Evidence from India Subnational sample, Nova School of Business and Economics, The Institute for Fiscal Studies, University of St. Andrews
COVID-19 Experience
First confirmed case: January 30, 2020
Number of confirmed cases: 198,370 as of June 1, 2020
Number of deaths: 5,608 as of June 1, 2020
Target Population
Random subset of slum populations in Lucknow and Kanpur, Uttar Pradesh, India. Socio-economic variables are only collected for a representative sample of the population relying on community toilets or open defecation to fulfil their sanitation needs.
Original Study Design
Randomized controlled trial, with complete census of households within 142 slums (September to December 2017), and a series of household and caretaker surveys, objective measurements, incentivized behavioural measurements, and a Structured Community Activity, collected for a sub-set of 100 slums between April 2018 and September 2019.
Intervention: Catchment areas of CTs were randomly allocated to two interventions. The first intervention aimed at community toilet improvements by offering caretakers the choice of a grant to be spent for improvements in the facility. Following the grant, caretakers were offered a large financial reward conditional on the cleanliness of the facility. The second intervention added to this CT improvement awareness creation among potential users through face-to-face information sessions, leaflets, monthly reminders using voice messages sent to mobile phones, and posters hung in the CTs.
Sampling Frame: A two-step sampling was applied, first, study households from the main study sample were sampled, then households from the whole slum population were added.
Survey Dates: Baseline: June to July 2020, Follow-up 1: October to November 2020, Follow-up 2: December 16, 2020 to January 18, 2021.
Sample size, tracking and attrition: 3,991 households, with a mean of 28 households per cluster (142). Non-response Baseline: 25%, Attrition rate Baseline to Follow-up (1 and 2): 13%, Randomly selected replacement households for Follow-up (1 and 2): 1,277.
Sampling Weights: Included
IRB Approval: Approval was secured from London School of Economics (REC ref. 1132). The pre-analysis plan was registered on the AEA RCT registry (RCT ID AEARCTR-0006564).
Mozambique Subnational sample, International Growth Center, Nova School of Business and Economics
COVID-19 Experience
First confirmed case: March 22, 2020
Number of confirmed cases: 12,777 as of October 30, 2020
Number of deaths: 91 as of October 30, 2020
Target Population
Microentrepreneurs in urban markets of Maputo and household heads from the province of Cabo Delgado.
Original Study Design
Initial data were collected in-person in two different studies. For microentrepreneurs in Maputo, the data were collected between October 2013 and April 2014 (baseline), and between July and November 2015 (endline).2 For household heads in Cabo Delgado, the data were collected in-person between August and September 2016 (baseline), and between August and September 2017 (endline).3
Intervention: The first study was dedicated to analyzing the impacts of interventions targeting microentrepreneurs in urban markets on financial inclusion and literacy. The second study focused on the role of information to counteract the political resource curse after a substantial natural gas discovery.
Sampling Frame: The first initial sample was selected by in-field random sampling in 23 urban and periurban markets in Maputo and Matola. Stratification was based on the gender of the respondent and on the type of establishment (stall vs. store). The second initial sample was selected to be representative of 206 communities in the province of Cabo Delgado, randomly drawn from the list of all 421 polling locations in the sampling frame, stratified on urban, semiurban, and rural areas. This survey in this paper was done by phone.
Survey Dates: October 30 to November 21, 2020 (Maputo) and November 6 to November 30, 2020 (Pemba).
Sample size, tracking and attrition: 554 microentrepreneurs from Maputo and 308 households from Cabo Delgado.
Sampling Weights: N/A
\emph{IRB Approval: The approval was secured from Universidade Nova de Lisboa on July 14, 2020.
Nepal, Western Terai Panel Survey (WTPS) Subnational sample, Yale University, Yale Research Initiative on Innovation and Scale (Y-RISE)
COVID-19 Experience
First confirmed case: January 23, 2020
Number of confirmed cases: 233,452 as of December 1, 2020
Number of deaths: 1,529 as of December 1, 2020
Target Population
Rural households in the districts of Kailali and Kanchanpur.
Original Study Design
Initial baseline data was collected in-person in July of 2019, and 5 rounds of phone survey data were collected between August 12, 2019 and January 4, 2020.
Sampling Frame
The phone survey sample includes 2,636 rural households in the districts of Kailali and Kanchanpur, which represent the set of households that responded to phone surveys from an original sample of 2,935 households. This sample was constructed by randomly sampling 33 wards from 15 of the 20 sub-districts in Kailali and Kanchanpur and selecting a random 97 villages from within those wards. At the time of baseline data collection in July of 2019, 7 of these 97 villages were dropped from the sample due to flooding. Households belong to the bottom half of the wealth distribution in these villages, as estimated by a participatory wealth ranking exercise with members of the village.
Survey Dates:December 1st - December 11, 2020
Sample size, tracking and attrition: 1,392 households
IRB Approval: This research was approved via Yale University IRB Protocol 2000025621.
Nigeria Subnational sample, WZB Berlin Social Science Center, University of Illinois Chicago
COVID-19 Experience
First confirmed case: February 28, 2020
Number of confirmed cases: 65,693 as of November 18, 2020
Number of deaths: 1,163 as of November 18, 2020
Target Population
Christian and Muslim men and women, age 18 and above, living in Kaduna state, Nigeria.
Original Study Design
Initial data was collected from a subset of the sample in December 2019 (in person survey) and July - Aug 2020 (phone survey) as part of an experiment testing the effects of a brief radio program on inter-religious animus. A random walk procedure and random sampling were used within households to recruit a representative sample of adults in Kaduna town. The rest of the sample was recruited for the study in Aug 2020 by purchasing phone lists for residents of Kaduna State.
Intervention: The study examines the effects of a radio program and a TV drama on inter-religious animus. The subset of the sample in the radio study was randomly assigned to listen to a brief radio program on one of the following topics: (1) an inter-religious storyline, (2) an intra-religious storyline, and (3) a message about maintaining safe health practices. All respondents in the sample participated in a study examining the effect of viewing an inter-religious storyline unfolding over a full season of a popular TV drama, Dadin Kowa. The season aired from Aug - Oct 2020. A third of the sample were encouraged to watch Dadin Kowa, a third were encouraged to watch the TV station Africa Magic Hausa at the same time Dadin Kowa aired, and a third were in the treatment-as-usual group. All participants received a weekly incentivized SMS quiz from Aug - Oct 2020.
COVID-19 Survey Design
This survey is not primarily about COVID-19, but was designed as an endline survey to follow the TV drama intervention described above. The goal of this survey is to measure a range of attitudinal outcomes related to Christian-Muslim relations (including prejudice, intergroup threat perceptions, dehumanization, and support for the use of violence, among others). We included nine of the standardized COVID-19 vaccine-related questions collected specifically for this vaccine acceptance study in the final module of the endline survey.
Sampling Frame: 950 respondents in the sample were recruited in person through a random sampling procedure in the Kaduna metropolitan area (pre-COVID). The remaining 1,700 respondents were recruited into the study over the phone from lists of phone numbers of Kaduna state residents that were purchased from a private vendor.
Survey Dates: November 18 - December 18, 2020.
Sample size, tracking and attrition: All 1,834 individuals who completed the endline survey are included.
Sampling Weights: N/A
IRB Approval: This study was reviewed by the IRB at the University of Pennsylvania (Protocol 834548), and it was determined on November 20, 2019 to meet the criteria for review exemption (45 CFR 46.104, category #2).
Pakistan
COVID-19 Experience
March 6: First confirmed case: February 26, 2020
Number of confirmed cases: 271,887 as of July 24, 2020
Number of deaths: 5,787 as of July 24, 2020
Pakistan, Economic Vulnerability Assessment (EVA) Subnational sample, Sheikhupura Police Study Sample, Institute of Development and Economic Alternatives, Lahore University of Management Science, London School of Economics, Princeton University (Pakistan 1)
Target Population
A representative sample of adults from 108 of 151 police beats in Sheikhupura and Nankana districts of Punjab Province.
Original Study Design
N/A
COVID-19 Survey Design
The EVA survey involved calls to all households in the stratified random sample for the policing study midline survey.
Sampling Frame: Households in Sheikhupura and Nankana districts.
Survey Dates: July 24 to September 9, 2020
Sample size, tracking and attrition: Sample includes 1,473 respondents.
Sampling Weights: Post-stratification weights are computed to adjust for the sampling process, which involved stratifying first on 27 police stations, then within each police station on beats, then PPS sampling within beats using Asiapop population data.
IRB Approval: This research was approved via Princeton University IRB Protocol 7250.
Pakistan, Economic Vulnerability Assessment (EVA) Subnational sample (Pakistan 2)
Target Population
All possible mobile phone numbers (in the province of Punjab) generated based on the local mobile phone number structure in Pakistan.
Original Study Design
N/A
COVID-19 Survey Design
The EVA survey involved making calls to individuals in Punjab based on random digit dialing.
Sampling Frame: Individuals with mobile phones in Punjab.
Survey Dates: September 2 to October 13, 2020
Sample size, tracking and attrition: Sample includes 1,492 respondents.
Sampling Weights: N/A.
IRB Approval: This research was approved by Lahore University of Management Sciences IRB Protocol LUMS-IRB/07012020SA.
Rwanda, Research for Effective COVID-19 Responses (RECOVR) National RDD Sample, Innovations for Poverty Action (IPA)
COVID-19 Experience
First confirmed case: March 14, 2020
Total cases: 5,017 as of October 22, 2020
Total deaths: 34 as of October 22, 2020
Target Population: A random sample of all numerically possible mobile phone numbers in the country, based on national communications authority number allocation plans.
Original Study Design
N/A
COVID-19 Survey Design
Phone survey
Sampling Frame: Numbers were called via random digit dialing (RDD), stratified by mobile network operator market share.
Survey Dates: October 22 to November 5, 2020 (Round 1 June 4 -12, 2020)
Sample size, tracking and attrition:Sample includes 1,355 respondents contacted in the second round of a panel of 1,480.
Sampling Weights: Post-stratification weights are computed to adjust for differential attrition between the first and second rounds of the RDD panel, weighting on gender, region, and educational attainment.
IRB Approval: This research was approved via IPA IRB Protocol 15591, Rwanda National Institute for Scientific Research permit No.0856/2020/10/NISR; and Rwanda National Ethics Committee approval No.16/RNEC/2020.
Russian Federation, Research on COVID-19 in Russia’s Regions (RoCiRR) Subnational sample, International Center for the Study of Institutions and Development (HSE University, Moscow, Russia) and Economics Department of Ghent University, WZB Berlin Social Science Center, Columbia University
COVID-19 Experience
First confirmed case: January 31, 2020
Number of confirmed cases: 1,720,063 as of November 6, 2020
Number of deaths: 29,654 as of November 6, 2020
Target Population
Adult internet users who reside in one of 61 federal subjects (federal cities, oblasts, republics, krais and autonomous okrug) of Russia. The regions included in the study are Republics: Bashkortostan, Karelia, Komi, Mariy El, Mordovia, Tatarstan, Udmurtia, Chuvashia. Krais: Altai, Krasnodarsky, Krasnoyarsky, Permsky, Primorsky, Stavropolsky, Khabarovsky. Oblasts: Arkhangelsk, Astrakhan, Belgorod, Bryansk, Vladimir, Volgograd, Vologda, Voronezh, Ivanovo, Irkutsk, Kaliningrad, Kaluga, Kemerovo, Kirov, Kostroma, Kurgan, Kursk, Leningrad, Lipetsk, Moscow, Murmansk, Nizhny Novgorod, Novgorod, Novosibirsk, Omsk, Orenburg, Orel, Pskov, Penza, Rostov, Ryazan, Samara, Saratov, Sverdlovsk, Smolensk, Tambov, Tver, Tomsk, Tula, Tyumen, Ulyanovsk, Chelyabinsk, Yaroslavl. Other: Moscow, Saint Petersburg, Khanty-Mansiysk Autonomous Okrug – Ugra. The remaining 24 federal subjects were excluded from the study due to inability to enroll sample size with desired characteristics (sample size, age, gender and education group composition) and account for less than 14% of the total adult population of Russia.
Original Study Design
N/A
COVID-19 Survey Design
The study was designed to measure the impact of pandemics on Russians, mostly those who live in cities with more than 100,000 residents. It contains a number of questions on the personal experience, norms and values, trust in government institutions, provision of social services, and mass media use. Region and geolocality of every respondent are recorded.
Sampling Frame: In total 25,558 respondents received the module on vaccine acceptance. The sample was enrolled from the pool of Russian online survey company OMI (Online Market Intelligence). The sampling was specifically targeted at having a minimum of 150 respondents in each of the 61 regions and including respondents from all the main age and gender groups within each region. Respondents were also selected so that at least 40% of respondents did not have higher education, in accordance with higher education rates in Russia. Out of 25,558 recruited respondents, 22,125 completed the survey. Among 22,125 respondents who completed the survey, 20,821 were enrolled from the general pull of the survey company respondents, while the remaining 1,304 respondents were enrolled among residents of cities with populations below 100,000 and rural areas.
Survey Dates: November 6 - December 1, 2020
Sample size, tracking and attrition: 22,125 respondents who completed the survey with the vaccine acceptance module included.
Sampling Weights: Post-stratification weights are computed to match marginal distributions of age, gender and education among the adult population of Russia with target proportions coming from the 2019 Yearbook and 2015 Microcensus released by Russian Federal Bureau of National Statistics (Rosstat).
IRB Approval: This study was approved via Columbia University IRB Protocol IRB-AAAT4453.
Sierra Leone
COVID-19 Experience
First confirmed case: March 20, 2020
Total cases: 2,252 as of October 2, 2020 and 3,030 as of January 20, 2021
Total deaths: 72 as of October 2, 2020 and 77 as of January 20, 2021
Sierra Leone, Research for Effective COVID-19 Responses (RECOVR) National RDD Sample, Innovations for Poverty Action (IPA) (Sierra Leone 1) Target Population: A random sample of all numerically possible mobile phone numbers in the country, based on national communications authority number allocation plans.
Original Study Design
N/A
COVID-19 Survey Design
Numbers were called via random digit dialing (RDD), stratified by mobile network operator market share
Sampling Frame: All active mobile phone numbers in Sierra Leone.
Survey Dates: October 2-19, 2020 (Round 1 May 27 to June 15, 2020)
Sample Size, tracking and Attrition: Sample includes 1,070 respondents contacted in the second round of a panel of 1,304.
Sampling Weights: Post-stratification weights are computed to adjust for differential attrition between the first and second rounds of the RDD panel, weighting on gender, region, and educational attainment.
IRB Approval: This research was approved via IPA IRB Protocol 15592, and Sierra Leone Ethics and Scientific Review Committee approval (no approval number, letter available upon request).
Sierra Leone, Towns that are Candidates for Rural Electrification Nation-wide sample, International Growth Centre (IGC), Wageningen University & Research, Yale Research Initiative on Innovation and Scale (Y-RISE), WZB Berlin Social Science Center and Columbia University (Sierra Leone 2) Project Title: Sierra Leone Rural Electrification (SLRE)
Target Population
Households in 195 rural towns across all 14 districts of Sierra Leone. Of these, 97 villages were selected to benefit from an electrification program.
Original Study Design
Initial baseline data was collected during late 2019 and early 2020 as part of a study to assess the impact of Rural Electrification in rural towns in Sierra Leone.
Intervention: The Government of Sierra Leone (GoSL) in collaboration with the United Nations Office for Project Services (UNOPS) and international donors is implementing the Rural Renewable Energy Project (RREP). In its first wave, during 2017, the project provided stand-alone solar photovoltaic powered mini-grids to 54 communities across the country. Construction of mini-grids in a further 43 towns is ongoing. In RREP communities, engineers construct 6kW–36kW power mini-grids that provide reliable power year-round. Electricity is free for schools and clinics. Residential and commercial users can acquire connections from commercial operators.
Village Sampling Frame: Household data was collected in 195 towns across all 12 districts of Sierra Leone. The GoSL selected 97 towns with (planned) mini-grids. We used Propensity Score Matching to select 98 control communities. Within communities, respondents were randomly selected from a census roster stratified by occupation status of farmers, business owners and other occupations [47 percent, 47 percent and 7 percent]. In each village, the intended sample was 43 households (20 farmers, 20 businesses, 3 others). Data was collected during June–July (108 communities) and November–December 2019 (87 communities). If a household on the sampling list was not available on the village visit day, we had a randomly sampled list of replacement households to survey. The replacement household would be the same occupation as the sampled household would have been so the sample ratio of 20-20-3 still held in each community.
COVID-19 Survey Design
The goal was to assess households’ degree of economic vulnerability in the face of the COVID-19 pandemic.
Sampling Frame: The COVID-19 survey data comprises 2,110 respondents from 186 towns from the original baseline survey. Phone surveys were attempted to all 195 rural communities from the baseline survey. The total baseline household sample comprised 7047 respondents. We recontacted all baseline respondents that listed a phone number (4,594 respondents) and obtained informed consent for the phone survey. We implemented several waves of the phone survey, recontracting a respondent about every month. In wave 7, we added questions related to Vaccine Acceptability.4.
Survey Dates: October 7, 2020 to January 20, 2021 (earlier rounds included Wave 1: April 29-May
15; Wave 2: May 15-June 4; Wave 3: June 5-June 17; Wave 4: June 17-June 30; Wave 5: July 1-August 8; Wave 6: August 19-October 1). The median survey time was 33 minutes.
Sample size, tracking and attrition: Data collection took place between October 7 and January 20, 2021with 2,110 respondents, in 186 towns for a tracking rate of 46 percent.
Sampling Weights: None
IRB Approval: Approval was secured from Sierra Leone Ethics and Scientific Review Committee (SLERC 2904202) and Wageningen University (24062020).
Uganda
COVID-19 Experience
First confirmed case: March 21, 2020
Total cases: 741 as of June 18, 2020 and 6,468 as of September 21, 2020
Total deaths: 0 as of June 18, 2020 and 63 as of September 21, 2020
Uganda Subnational sample, International Growth Center, Trinity College Dublin, Stockholm School of Economics and Misum, Institute for International Economic Studies, Stockholm University (Uganda 1) Target Population: Women from semi-rural and rural villages across 13 districts in Uganda (Iganga, Kayunga, Mbale, Mityana, Apac, Dokolo, Gulu, Adjumani, Koboko, Maracha, Nebbi, Soroti, Kumi).
Original Study Design
Initial baseline data was collected in 2016 as part of a large cluster randomized controlled trial, with the aim of selecting households likely to have children during the study period. Four criterias for selection were thus used, in descending order of importance: the household has a woman that is currently pregnant, or aged 16-30 years old, with a young child less than three years old, and/or married (formally or informally). In each household, the respondent was chosen as the female household head or the primary female health care giver of the household if the household head could not be found.
COVID-19 Survey Design
The data was collected through multiple rounds of phone surveys. The variable measuring age was constructed by approximation, using the baseline data from 2016 and adding 4 years to the 2016 measure. When the baseline respondent was replaced, the initial age information was deleted.
Sampling Frame: Households were selected within 500 clusters (the village of the household).
Survey Dates: September 21 to December 06, 2020.
Sample size, tracking and attrition: Out of 2,743 respondents, 1752 were included, provided that they answered the main question about vaccine uptake.
Sampling Weights: None.
IRB Approval: Mildmay Uganda Research Ethics Committee (protocol number 0109-2015) on September 21, 2020.
Uganda Subnational sample, WZB Berlin Social Science Center and Columbia University, NYU Abu Dhabi, Innovations for Poverty Action (IPA) (Uganda 2)
Target Population
All residents of Kampala who are Ugandan citizens, above the age of 18, and agree in principle to attend a short citizen consultative meeting.
Original Study Design
Baseline data was collected between July and October 2019 for an intervention that randomized citizen attendance to a set of 188 consultative meetings organized across Kampala. The meetings were organized to collect citizen preferences for the design of a forthcoming municipal citizen charter. The study also aimed to assess patterns of political inequality in meeting participation, dynamics, and outcomes, as well as study the subsequent effects on prosociality of being incorporated in this participatory process. 1/3 of the sample was randomly allocated to control, while 2/3 of respondents were invited to attend a consultative meeting. The consultations took place between November 2019 and February 2020 across Kampala divisions.
Intervention: The intervention consisted of attendance at the consultative meeting organized a few months after baseline data collection. A further randomization allocated ½ of the invited participants to a meeting moderated by a local bureaucrat, while the remaining ones attended a meeting moderated by a neutral discussion leader.
COVID-19 Survey Design: The COVID-19 survey sample comprises the 2,189 respondents to the baseline who were selected on the basis of their residence in the city. Having received permission to re-contact these individuals, we coordinated a 3-wave panel throughout the summer and fall of 2020, with respondents contacted via phone. The goal was to assess households’ degree of economic vulnerability in the face of the COVID-19 pandemic and respondents’ evaluations of performance of political actors in tackling the pandemic.
Sampling Frame: The 2,189 respondents to the baseline were randomly selected from a sampling frame of all buildings in Kampala, for which information about their geographical coordinates was available. After randomly selecting a set of candidate structures, interviewers sampled respondents from the subset of structures that were residential.
Survey Dates: Wave 1: June 18–July 23. Wave 2: September 4–29. Wave 3: November 23–December 12.
Sample size, tracking and attrition: Of the 2,189 respondents which we aimed to contact, we were able to reach 1,333 in Wave 1, 1,289 in Wave 2, and 1,366 in Wave 3. Wave 3 contained the COVID-19 vaccine module presented in this analysis.
Sampling Weights: None.
IRB Approval: The study was approved by IPA Global IRB (protocol number 15018) on May 29, 2020; WZB Berlin Social Science Center Ethics Review Board (protocol number 2020/0/91) on June 10, 2020; NYU Abu Dhabi IRB (protocol number HRPP-2020-64) on May 27, 2020; MIT Committee on the Use of Humans as Experimental Subjects (protocol number 2005000155) on June 3, 2020; and by the Mildmay Uganda Research Ethics Committee (protocol number 0604-2019) on June 11, 2020.
United States of America Nation-wide sample, WZB Berlin Social Science Center, Cornell University, Tufts University
COVID-19 Experience
First confirmed case: January 20, 2020
Total cases: 14,499,637 as of December 4, 2020
Total deaths: 281,678 as of December 4, 2020
Target Population
Nation-wide sample of adult internet users recruited through the market research firm Lucid.
Original Study Design
N/A
Intervention: N/A
COVID-19 Survey Design
This survey was part of a panel study on attitudes toward COVID-19 technologies and public health surveillance.
Sampling Frame: The Lucid Marketplace is an automated marketplace that connects researchers with willing online research participants. Lucid partners with a network of companies that maintain relationships with research participants by engaging them with research opportunities. While Lucid does not provide probability samples of the U.S. adult population, its quota samples approximate the marginal distributions of key demographic characteristics. Recent validation exercises have found that Lucid samples approximate nationally representative samples in terms of demographic characteristics and survey experiment effects.5
Survey Dates: December 4-5, 2020
Sample size, tracking and attrition: 1,959 individual online surveys. In the main question regarding intention to take the vaccine, approximately 10% of respondents (184) did not answer Sampling Weights: Post-stratification weights are computed to match marginal population distributions of income, age, education, gender, race and region among the US adult population, with target proportions based on the 2018 American Community Survey.
IRB Approval: This study received approval from the Cornell University IRB under Protocol #2004009569.
Footnotes
↵* First author.
† Last author.
↵1 Dong, E., Du, H., & Gardner, L. (2020). An interactive web-based dashboard to track COVID-19 in real time. The Lancet infectious diseases, 20(5), 533-534.
↵2 Original study: http://catiabatista.org/bsv_mm_urban.pdf
↵3 Original study: https://www.aeaweb.org/articles?id=10.1257/aer.20190842
↵4 The data was first reported in https://www.theigc.org/wp-content/uploads/2020/05/Meriggi-et-al-Data-Brief-2020.pdf
↵5 See for instance: https://journals.sagepub.com/doi/10.1177/2053168018822174