Does the timing of government COVID-19 policy interventions matter? Policy analysis of an original database

M. Stephens, J. Berengueres, S. Venkatapuram, I. A. Moonesar
doi: https://doi.org/10.1101/2020.11.13.20194761

ABSTRACT

Objective Though the speed of policy interventions is critical in responding to a fast spreading pandemic, there is little research on this topic. This study aims to (1) review the state of research on the topic (2) compile an original dataset of 87 COVID-19 non-pharmaceutical interventions across 17 countries and (3) analyses the timing of COVID-19 policy interventions on mortality rates of individual countries.

Design Statistical analysis using Excel and R language version 3.4.2 (2017-09-28) of 1479 non-pharmaceutical policy interventions data points.

Setting China, Singapore, South Korea, Japan, Australia, Germany, Canada, India, United Arab Emirates, United States of America, South Africa, Egypt, Jordan, France, Iran, United Kingdom and Italy.

Population 36 health policies, 19 fiscal policies; 8 innovation policies; 19 social distancing policies, and 5 travel policies – related to COVID-19.

Interventions We calculate the time (time-lag) between the start date of a policy and three-time specific events: the first reported case in Wuhan, China; the first nationally reported disease case; the first nationally reported death.

Main Outcome Measures National level mortality rates across 17 countries. Mortality rate is equivalent to (death attributed to COVID-19) / (death attributed to COVID-19 + COVID-19 recovered cases).

Results The literature review found 22 studies that looked at policy and timing with respect to mortality rates. Only four were multicountry, multi-policy studies. Based on the analysis of the database, we find no significant direction of the association (positive or negative) between the time lag from the three specified points and mortality rates. The standard deviation (SD) of policy lags was of the same order of magnitude as the mean of lags (30.57 and 30.22 respectively), indicating that there is no consensus among countries on the optimal time lags to implement a given policy. At the country level, the average time lag to implement a policy decreased the longer the time duration between the country’s first case and the Wuhan first case, indicating countries got faster to implement policies as more time passed.

Conclusions The timing of policy interventions across countries relative to the first Wuhan case, first national disease case, or first national death, is not found to be correlated with mortality. No correlation between country quickness of policy intervention and country mortality was found. Countries became quicker in implementing policies as time passed. However, no correlation between country quickness of policy intervention and country mortality was found. Policy interventions across countries relative to the first recorded case in each country, is not found to be correlated with mortality for 86 of the 87 policies. At the country level we find that no correlation was found between country-average delays in implementing policies and country mortality. Further there is no correlation with higher country rankings in The Global Health Security Index and policy timing and mortality rates.

Funding Statement This work was supported by the Alliance for Health Policy and Systems Research at the World Health Organization as part of the Knowledge to Policy (K2P) Center Mentorship Program.

A competing interests statement”All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coidisclosure.pdf and declare: IAM and MS would like to acknowledge the Alliance for Health Policy and Systems Research at the World Health Organization for financial support for publishing as part of the Knowledge to Policy (K2P) Center Mentorship Program [BIRD Project].

INTRODUCTION

With regard to policymaking during a pandemic, there are several assumptions being made. First, there is an assumption being made that early policy interventions would lower transmission rates and mortality rates.1,2,3 However, this generally accepted view of the relevance and importance of timing of policy interventions from past epidemics is supported by very few studies. 4,5,6 The World Health Organization Writing Group stresses that pandemic interventions are often based on limited information and vary depending on the context.7 There are competing concerns that countries need to manage, and these may be influenced by internal events (elections) or external events (global reputation).8,9

Often the urgency of policy interventions focuses on one of two effects – saving lives and staunching the effects of the disease on the economy.10,11,12 Existing studies of COVID-19 policy interventions look at policies in isolation like travel restrictions,13 contact tracing,14 proactive testing,15 isolation, and social distancing,16 lockdowns,17,18 or school closure.19 Single policy studies may not accurately reflect the complexity of the situation (health, economy, societal concerns, for example). The World Health Organization recommends whole-of-society coordination mechanisms to support preparedness and response, including the health, transport, travel, trade, finance, security and other sectors”.20 A recent study on the timing for social distancing, in Wuhan (Hubei, China), South Korea, Japan, Hong Kong, Singapore, and Italy between January and March 2020 finds that the implementation of the social distancing policy was random.21 There are few multi-policy studies available.

In a majority of cases,where those studies exist, they examine policy implementation in a single country and assume the findings are transferable across borders.22,23 Few multi-country, multi-policy studies exist. We found one study24 that looked at 17 policies, but all focused on various types of social distancing measures. The countries studies were China (Wuhan), South Korea, Japan, Hong Kong, Singapore, and Italy. The study finds that the information available was sparse and based on what they collected, they state that it is difficult to quantitatively assess the efficacy of many interventions, though they do conclude that social distancing slows the spread of the disease. On the other hand, a muti-country, multi-policy study covering China, South Korea, Italy, Iran, France, and the United States, focusing on travel restrictions, social distancing through cancellations of events, suspensions of educational/commercial/religious activities, quarantines, lockdowns, state of emergency declarations, and expansions of paid sick leave, found that policies slow COVID-19 virus contagion as measured by cases and deaths.25

Some studies have cautioned against applying learnings from previous pandemics to the present one, and stress that more data is needed on interventions and their impact in individual countries.26,27 Due to the relatively little research across countries and the robustness of findings on the timing of policy interventions and mortality, this study aims to evaluate the timing of policy intervention and their correlation to mortality rates. This research will (1) conduct a systematic review of COVID-19 papers that study the impact of the timing of the policies intervention on mortality rates (2) compile a dataset of COVID-19 policy interventions across 17 countries (3) evaluate the correlation of the quickness of a country-level policy intervention on country mortality rate and (4) evaluate given policy across countries, to assess if there is a correlation between quickness and mortality rate.

METHODS

We conducted a systematic review of studies on the impact of timing of policy intervention on mortality rates during the COVID-19 period. The search was limited to COVID-19 policies and interventions published in the English language for articles indexed in PubMed and Proquest that were published between January 2020 and May 2020. The keywords included: COVID-19 ‘timing of policy’, ‘non-pharmaceutical interventions, epidemics/pandemics, health crisis, outbreaks, on mortality rates.

To create the dataset, we identified 87 COVID-19 policy interventions across 17 countries, daily COVID-19 cases, and mortality rates. The start date is from December 31 2019, and the end date is May 16 2020. The data collection was conducted between April 6 2020, and June 4 2020. The start dates of 87 policy interventions were collected using various sources such as OxCGRT,28 data from Institute Montaigne, government websites, research papers, press releases, press conferences, and newspaper reports. In many cases, the start date of the policy is not explicitly given. We use the date of the first announcement of the policy. Once the start date was determined, the lag in days between the start date and (1) the first case in Wuhan (2) first case in the country and (3) the first confirmed death in the given country was then calculated. The assumption we make is that the policy is deployed in response to the local COVID-19 situation.29

Deaths and cases were compiled using daily reports from the European Centre for Disease Prevention and Control. We decided to use the mortality rate to compare countries as it is a more robust measure of the pandemic outcomes. We define mortality rate as (death attributed to COVID-19) / (deaths + recovered cases).30

The 17 countries chosen for analysis are among the first affected countries and are identified as having medium to high rankings on the 2019 Global Health Security Index (see Table 1). Three critical events happened during the time the sample countries had their first infection: Wuhan Lockdown (3 countries), Chinese New Year (which was a significant milestone for transmission of the disease)31 and WHO declaration of Public Health Emergency (6 countries), and WHO declaration of pandemic (8 countries). All these events could be considered as early warning signals for governments to plan policy interventions (Appendix 1). The countries are representative of three continents Asia, Europe, and North America.

View this table:
Table 1:

Ranking of Sample Countries

Table 1 presents a ranking of countries ranked as ‘most prepared’, ‘more prepared’, and ‘least prepared’ from the Global Health Security Index 201932 and the Worldometer COVID-19 Mortality Ranking as of May 16, 2020.33

ANALYSIS

The review identified 142 relevant studies focusing on COVID-19 related non-pharmaceutical intervention (NPI) policies. After screening by abstract/title, 28 studies were selected for full-text assessment. Of them, 22 were finally selected (see Appendix 2). The majority of the studies focused on a single country (n=18) or a small group of countries (n=4) with similar policy interventions (for example, school closure (n=8). China was the most studied country (37%, n=8), followed by the USA (27%, n=6), then Iran (1), Canada (1), Lebanon (1), and Taiwan (1). There were four multiple country studies: West Africa as a region, a global study on YouTube videos with no specific country identified; one looking at China, Iran, Japan, Italy, and South Korea; and a two-country study looking at Spain and the UK. The study period for these studies was from December 2019 to May 2020. The majority of studies used a quantitative research design (n=19), where the main focus was on timely and accurate dissemination of policies in terms of managing during pandemics.

Though these studies used the word timing, they did not investigate the impact of the timing of the policy intervention on mortality rates during the COVID-19 period. Instead, these studies looked at which public policy measures and interventions were critical in limiting the spread of COVID-19 over a particular time period.34,35,36,37 One study suggested that policymakers could have the best chance for policy learning due to the time lag between the China outbreak COVID-19 and the spread in the context of Iran.38 The papers have highlighted the need for the importance of delivering timely and accurate information.39,40,41,42,43

Our original dataset analysis was at two levels: looking at time lags at the country-level and the policy-level. We treat time lags in a similar way, as previously done in a big data modeling application.44 The time lag between policy implementation and a COVID-19 milestone was defined as the number of days between the policy start date and the given milestone date. We run statistical models for three different milestones: (i) the first case confirmed in the country, (ii) the first death in the country and, (iii) the date of the first case in Wuhan, China, and their correlation to COVID-19 mortality rates. The effectiveness and degree of enforcement have not been evaluated here, as there can be variance in implementation across geographical regions within a country, particularly in large federal governance structures, autonomous regions, and so forth. Hence, each policy time lag is relative to one global event (China first case) and two country-specific milestones.

At the policy level, to assess the linear association and direction between country mortality and policy time lag, we used the Spearman’s rank correlation coefficient. However, both Spearman and Pearson yielded similar results for the three different milestones considered. Table 2 shows a matrix of time lags (each cell is a time lag) where rows are the 87 policies and columns are the 17 countries. Each cell indicates the distance in days between the first confirmed case and the start of the policy in each given country. A negative figure indicates how many days before the first confirmed case, the policy was implemented. A positive number shows how many days the policy was implemented after the first confirmed case. A blank indicates that there is no data available because the policy was either never implemented in the given country or information is not available.

View this table:
Table 2

List of policies and their implementation delay (time delay/time lag variable) since the first confirmed case for each country.

For each policy, we calculate the correlation with country-specific indicators such as mortality rate, which is equivalent to (death attributed to COVID-19) / (death attributed to COVID-19 + COVID-19 recovered cases). We choose this indicator because it reflects how effectively the country is coping. Then we compute the Spearman rank correlation coefficient, confidence intervals, and p-values. For reference, we also computed Pearson coefficients. The same analysis, mentioned above, was conducted with different COVID-19 curve milestones (Nth death, Mth case). The results are similar and provided in the appendix. A dynamic Excel sheet is also provided where N and M are parameters that can be modified, and the Pearson and Spearman coefficients are re-calculated on the go. The analysis was conducted both in Excel and R language (version 3.4.2 2017-09-28). The Spearman p-values were computed both in Excel and in R using the SpearmanCI package. Slight differences (+/-5%) in the Spearman coefficient values due to different slight formulas used by both Excel and SpearmanCI are also noted, and confirm the differences stated previously by the authors of the SpearmanCI package.45 For 86 policies, no significant correlation was found. Only one policy was found to be weakly correlated, the policy for isolation of the infected, with a sample size of 12 countries applying the policy, and a Spearman Coefficient =0.63; (95% CI [0.27 - 0.91] p-value 0.03). See Figure 1.

Figure 1:
Figure 1:

Lag in implementing Isolation policy at the Country Level

At the country level, we ran a linear regression to quantify whether countries implement policies quicker as time lapsed (see Table 3 and Figure 2). In the regression, the days elapsed since each country’s reported first case and the Wuhan first case was the dependent variable. The independent variable is the mean of each policy time lags for each country. The linear regression yields Multiple R-squared: 0.511, Adjusted R-squared: 0.476, and a p-value: 0.001. Intercept 45.51, slope – 0.55. For every day elapsed since the Wuhan first case was reported, countries reduced the average delay to implement a policy relative to their own first case by half-day approximately. However, no correlation was found between country-average delays in implementing policies and country mortality. Furthermore, no conclusive association was found either between the Global Health Security Index scores of countries and mortality (Figure 3).

View this table:
Table 3

Country-level statistics and stats on time lags since the first confirmed case.

Figure 2:
Figure 2:

Density of new COVID-19 policies for the 17 countries considered. Countries ordered by descending mortality. Y is density of new COVID-19 policies. X is time lag since country first case.

Figure 3:
Figure 3:

Country-average delay in implementing a policy and country mortality

We find that having a higher score in the 2019 Global Health Security Index did not mean the country handled the pandemic better (see Figure 3).

Figure 4 shows the distribution of time-lags relative to the first confirmed case in each country. Mortality rates are ranked by the countries (least to highest). This diagram highlights the fact that policy delays or policy implementation quickness are not correlated to mortality rate.

Figure 4:
Figure 4:

Time-lag per policy for each country

FINDINGS

No Correlation found between Policy Timing and Mortality Rate

We examined 87 policies across 17 countries. The timing of policy interventions in and across countries relative to (1) first case in Wuhan, China, (2) first recorded case in each country and (3) first recorded death in each country, is not found to be correlated with mortality, though we find that countries became quicker in introducing policy interventions as time passed. This finding supports the recent conclusions of other researchers46 who state, “countries that have flattened death curves earliest may not provide a basis for extrapolating trends in areas where similar control could prove elusive.” Interventions likely had reinforcing effects and were driven by critical behaviour changes within local communities47 and perhaps existing conditions in public health infrastructure.

No significant direction of the association was found (positive or negative) except for one policy (“Isolation of only infected”). This policy showed a positive association between the quickness to implement the policy and mortality (Spearman coefficient +0.61 95% CI [0.27 - 0.91]). Other researchers found that isolating all positive cases, including the asymptomatic, helped in containing the virus. 48

Policies across countries are not implemented with the same urgency

The SD of policy time lags was of the same order of magnitude as the mean of lags (30.57 and 30.22 respectively), indicating that there is no agreement between countries on what are the optimal times to start a given policy (see Figure 5). This is surprising as a pandemic requires some coordination across borders. This was a fast-spreading virus. In our sample, three countries identified their first case from the first case in China to January, 6 countries between the Wuhan Lockdown and the Chinese New Year/WHO Global alert (8 days), and another 8 countries between the WHO Global Alert and Pandemic declaration (40 days).

Figure 5:
Figure 5:

Time-lag of policy concerning the first case across countries

Countries implement policies faster from Wuhan first case

The average time to implement a policy decreased the farther the country’s first case was dated from the Wuhan first case, indicating that countries became quicker in policy responses, which may also indicate that they also could have become more pre-emptive in policy responses as the pandemic evolved. This finding is in line with the Oxford policy study that finds internationally, government policy responses have become more stringent as more time passes.49

No correlation between country ranking and country policy timing implementation

We find no correlation with higher country rankings in The Global Health Security Index and policy timing and mortality rates. Such indexes do not capture those “other” factors50,51 or help in identifying the factors that were instrumental in some countries managing the pandemic response better (geographical isolation, population conformity to mask-wearing). Such country-specific factors can span social,52 environmental, and political factors53, often requiring behavioral insights,54 not captured in many quantitative models.

DISCUSSION

Our findings indicate there needs to be stronger global coordination across countries and coordination within countries (federal and local) on policy formulation, timing, and implementation. Our study suggests that the limited impact of policy timing on mortality may arise if the country does not have the underlying systems, strategies, and culture in place. While WHO does highlight the importance of multi-sector planning for non-pharmaceutical public health measures,55 the reports for guidance are outdated: the only existing pandemic report focuses only on influenza is dated 200956; the other relevant reports on infection prevention and control (IPC) programmes is dated 2019 and the “Managing epidemics” is dated 2018.57

The quality of timely data that needs to be shared within countries and across borders needs to be increased. One of the challenges of studies like this is understanding the time it takes for a policy to be implemented and for it to take effect. A policy announcement does not automatically mean that a policy implementation took place. Two studies found that the announcement of the public health intervention and its subsequent implementation, showed little evidence of any impact.58,59 At times, the signal that the policy introduction communicates may provide an illusion of impact (like in monetary policies and stock market reactions).60

CONCLUSION

Top-down policy implementation may not translate as relevant to a bottom-up perspective.61 This could be the issue of coordination, execution, or the political will not be resonating with communal interests.62,63,64 Policy implementation presupposes collaborative governance – where relevant stakeholders have an incentive or history of working together towards a common outcome.65 Policy failure can occur as a result of bad execution, bad policy, or bad luck.66

We suggest future research draw on a more extensive dataset of all country responses, the easing of COVID-19 policy responses, and study the reinforcing effects of policies on society. This is because socio-demographic heterogeneity and country policy differences across national borders, interventions may have different effects. Caution needs to be taken when extrapolating learnings across countries.67

STRENGTHS OF THE STUDY

  • This study was an exhaustive policy study that involved manually compiling a policy database of and 1479 policies and case and mortality data for the period between December 31 2019 to May 31 2020.

  • Visualization of the results allow policy makers to have greater clarity on responsiveness to the pandemic.

LIMITATIONS OF THE STUDY

  • The term timing has been used fluidly in literature reviews and most studied do not focus on when the policy was introduced but before and after a policy intervention. In our case the word timing refers to quickness of response of policy intervention and its impact on mortality.

  • Policy implementation dates are based on announcement as there is no clarity on level of implemntion.

  • In some cases policy interventions are announced at a city, region or state-level however in that case we have still assumed it is the first date of implementation in that country.

  • The findings may change as the sample size increases and as policy interventions ease.

Data Availability

Most of the data used in this study are freely available from the sources cited. The dataset is uploaded on Harvard DataVerse: Stephens, M., Lopez Berengueres, J.O., Moonesar, I.A. and Venkatapuran, S (2020), 1479 data points for COVID19 Policy responses, Harvard DataVerse. DOI:doi/10.7910/DVN/6VMRYG. The program is available by request to JB.

https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/6VMRYG

Contributors

This was a joint interdisciplinary project with each team member contributing to the project based on their expertise. MS conceived the study. MS and IAM acquired and managed the data, and IM conducted systematic reviews. JB analyzed the data and created the figures. MP, JP, and SV interpreted the results, and MS and IAM provided important local insights. MS, SV, and IAM drafted the first version of the manuscript with inputs from JB. The second version was redrafted by MS and SV with additional inputs from IM and JB. JB was responsible for visualization. MS supervised the work. MS is the guarantor and accepts full responsibility for the work and the conduct of the study, access to the data, and controlled the decision to publish. All co-authors provided critical comments and approved the final version of the manuscript. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. MS has an innovation and strategy background. SV has a public health and ethics background. IAM has a global health policy background, and JB has a statistics and visualization background.

Funding

We would like to acknowledge the Alliance for Health Policy and Systems Research at the World Health Organization for financial support as part of the Knowledge to Policy (K2P) Center Mentorship Program [BIRD Project].

Competing interests

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: IAM and MS would like to acknowledge the Alliance for Health Policy and Systems Research at the World Health Organization for financial support for publishing as part of the Knowledge to Policy (K2P) Center Mentorship Program [BIRD Project].

Patient consent for publication

Not required.

Ethical approval

Not required. All data sources used were fully publicly available. Further, the lead authors affirm that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as initially planned (and, if relevant, registered) have been explained.

Data sharing

Most of the data used in this study are freely available from the sources cited. The dataset is uploaded on Harvard DataVerse: Stephens, Melodena; Lopez Berengueres, Jose Oriol; Moonesar, Imanuel; Venkatapuram,Sridhar, 2020, “1479 data points of covid19 policy response times”, https://doi.org/10.7910/DVN/6VMRYG, Harvard Dataverse, V1, UNF:6:Uk0ndRTK8gKGJ01mKC960A== [fileUNF] The Kaggle code is available on request from JB.

Dissemination to participants and related patient and public communities

Upon request, the data will be available for policymakers and government bodies.

Patient and Public Involvment

Patients or the public WERE NOT involved in the design, or conduct, or reporting, or dissemination plans of our research

ACKNOWLEDGMENTS

The authors would like to thank the help we received Pavel Nesterov and Jorge Remon in modelling and Reem Gaafar for some data gathering.

Appendix 1: Spread of Disease for sample countries and key events (2019-2020)

Appendix 2: Systematic Review of Studies Using PRISMA 2009 Flow Diagram

Keywords

COVID-19 ‘timing of policy’ or ‘policy timing’ or ‘timing of NPIs’ or ‘interventions’ or ‘policy interventions’; NPIs,’ or ‘nonpharmaceutical intervention’ or ‘non-pharmaceutical intervention’; ‘public health surveillance’; ‘epidemics health crisis’; ‘pandemics health crisis’; ‘outbreaks health crisis’; ‘outbreaks on mortality rates’; ‘time series analysis’; ‘health alert notice’; ‘workplace closure’; ‘border control’; ‘travel restriction’ or ‘travel precaution’; ‘school closure’; ‘case reporting’; ‘disinfection or decontamination’; ‘Infection control’; ‘public gathering’ or ‘group gathering’ or ‘group event’ or ‘public place’; ‘prevention’ or ‘mitigation’; ‘exit screening’ or ‘entry screening’ or ‘thermal screening’; ‘personal protective equipment’; ‘face mask’ or ‘facemask’ or ‘surgical mask’ or ‘N95’ or ‘respirator’; ‘hand hygiene’ or ‘hand washing’ or ‘handwashing’ or ‘hand disinfection’; ‘prevention’ or ‘mitigation’;

Figure

Journals reviewed

PLoS One OR International Journal of Environmental Research and Public Health OR BMC Public Health OR PLoS Medicine OR BMJ Open OR PLoS Neglected Tropical Diseases OR Viruses OR Intensive Care Medicine Experimental OR Annals of Intensive Care OR PLoS Computational Biology OR PLoS Pathogens OR Scientific Reports (Nature Publisher Group) OR BMJ OR Clio Medica Online OR European Journal of Risk Regulation OR Globalization and Health OR Head & Neck OR BMC Infectious Diseases OR BMC Medicine OR BMJ Best Practice OR Epidemiology & Infection OR Global Health Action OR Homeland Security Affairs OR Infection Control & Hospital Epidemiology OR International Journal of Health Geographics OR Systematic Reviews OR An International Perspective on Disasters and Children’s Mental Health OR Asia & the Pacific Policy Studies OR BMC Health Services Research OR BMC Medical Research Methodology OR BMC Research Notes OR BMJ Global Health OR Clinical Medicine Insights. Oncology OR Disaster Medicine and Public Health Preparedness OR Health Expectations OR Health Research Policy and Systems OR Journal of Global Health OR Journal of Global Infectious Diseases OR Journal of Health, Population and Nutrition

Footnotes

  • Email: jse{at}ieee.org jose{at}uaeu.ac.ae

  • Email: sridhar.venkatapuram{at}kcl.ac.uk

  • Email: Immanuel.Moonesar{at}mbrsg.ac.ae

REFERENCES

  1. 1.↵
    Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72l□314 cases from the Chinese Center for Disease Control and Prevention. JAMA. Published online February 24, 2020. doi:10.1001/jama.2020.2648
    OpenUrlCrossRefPubMed
  2. 2.↵
  3. 3.↵
    Hsiang, S. et al. The effect of large-scale anti-contagion policies on the COVID-19 pandemic. Nature 2020; doi:10.1038/s41586-020-2404-8
    OpenUrlCrossRefPubMed
  4. 4.↵
    Hatchett, RJ, Mecher, CE, Lipsitch, M. Public health interventions and epidemic intensity during the 1918 influenza pandemic. Proceedings of the National Academy of Sciences, 2007; 104(18), 7582–7587.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    Chowell G, Nishiura H. Transmission dynamics and control of Ebola virus disease (EVD): a review. BMC medicine. 2014 Dec 1;12(1):196.
    OpenUrl
  6. 6.↵
    WHO Writing Group. Nonpharmaceutical interventions for pandemic influenza, national and community measures. Emerging infectious diseases, 2006; 12(1), 88.
    OpenUrl
  7. 7.↵
    Ibid.
  8. 8.↵
    Subarkah, AR, Bukhari, AS. South Korean Health Diplomacy in Facing COVID-19. Jurnal Inovasi Ekonomi, 2020; 5(3).
  9. 9.↵
    Oxford Analytica. China will exploit COVID-19 as diplomatic opportunity. Emerald Expert Briefings, (oxan-db). 2020; 2633–304X
  10. 10.↵
    Anderson, R. M., Heesterbeek, H., Klinkenberg, D., & Hollingsworth, T. D. How will country-based mitigation measures influence the course of the COVID-19 epidemic?. The Lancet, 2020; 395(10228), 931–934.
    OpenUrl
  11. 11.↵
    De Vito, A, Gómez, JP. Estimating the COVID-19 cash crunch: Global evidence and policy. Journal of Accounting and Public Policy, 2020; 39(2):106741
    OpenUrl
  12. 12.↵
    Atkeson, A. (What will be the economic impact of COVID-19 in the US? Rough estimates of disease scenarios (No. w26867). 2020; National Bureau of Economic Research.
  13. 13.↵
    Bhatia S, Imai N, Cuomo-Dannenburg G, et al. Report 6-Relative sensitivity of international surveillance. Imperial College London, MRC Centre for Global Infectious Disease Analysis. 2020 21 February; https://www.imperial.ac.uk/mrc-global-infectious-disease-analysis/covid-19/report-6-international-surveillance/ (accessed 2020 12 June).
  14. 14.↵
    Day, M. Covid-19: identifying and isolating asymptomatic people helped eliminate virus in Italian village. Bmj, 2020; 368, m1165.
    OpenUrlFREE Full Text
  15. 15.↵
    Wang, CJ, Ng, CY, Brook, RH. Response to COVID-19 in Taiwan: big data analytics, new technology, and proactive testing. Jama, 2020; 323(14), 1341–1342.
    OpenUrl
  16. 16.↵
    Hopman, J, Allegranzi, B, Mehtar, S. Managing COVID-19 in low-and middle-income countries. Jama, 2020; 323(16), 1549–1550.
    OpenUrlPubMed
  17. 17.↵
    Alvarez, FE, Argente, D., Lippi, F. A simple planning problem for covid-19 lockdown (No. w26981). 2020; National Bureau of Economic Research.
  18. 18.↵
    Medeiros de Figueiredo A, Daponte Codina A, Moreira Marculino Figueiredo DC, Saez M & Cabrera León A. Impact of lockdown on COVID-19 incidence and mortality in China: an interrupted time series study. [Preprint]. Bull World Health Organ. E-pub: 6 April 2020; DOI: 10.2471/BLT.20.256701
    OpenUrlCrossRef
  19. 19.↵
    Viner, RM, Russell, SJ, Croker, H, et al. School closure and management practices during coronavirus outbreaks including COVID-19: a rapid systematic review. The Lancet Child & Adolescent Health. 2020; DOI:10.1016/S2352-4642(20)30095-X
    OpenUrlCrossRefPubMed
  20. 20.↵
    WHO. Responding to community spread of COVID-19, dated 7 March 2020; Available: https://www.who.int/publications/i/item/responding-to-community-spread-of-covid-19 (accessed 2020 16 June)
  21. 21.↵
    Imai, N., Gaythorpe, K. A., Abbott, S., et al. Adoption and impact of non-pharmaceutical interventions for COVID-19. Wellcome Open Research, 2020;5(59), 59.
    OpenUrl
  22. 22.↵
    Ibid.
  23. 23.↵
    Raoofi A, Takian A, Sari AA, Olyaeemanesh A, Haghighi H, Aarabi M. COVID-19 pandemic and comparative health policy learning in Iran. Archives of Iranian Medicine. 2020 Apr 5;23(4):220–34.
    OpenUrl
  24. 24.↵
    Imai, N, Gaythorpe, KAM, Abbott, S, et al. Adoption and impact of non-pharmaceutical interventions for COVID-19, Wellcome Open Res 2020; 5:59 https://doi.org/10.12688/wellcomeopenres.15808.1 (accessed 2020 2 June)
    OpenUrl
  25. 25.↵
    Hsiang, S. et al. The effect of large-scale anti-contagion policies on the COVID-19 pandemic. Nature 2020; DOI: 10.1038/s41586-020-2404-8
    OpenUrlCrossRefPubMed
  26. 26.↵
    Miller, MA, Viboud, C, Balinska, M, Simonsen, L. The signature features of influenza pandemics—implications for policy. New England Journal of Medicine, 2009; 360(25), 2595–2598.
    OpenUrlCrossRefPubMedWeb of Science
  27. 27.↵
    Viner, RM, Russell, SJ, Croker, H, et al. School closure and management practices during coronavirus outbreaks including COVID-19: a rapid systematic review. The Lancet Child & Adolescent Health. 2020; DOI: 10.1016/S2352-4642(20)30095-28
    OpenUrlCrossRef
  28. 28.↵
    Oxford COVID-19 Government Response Tracker (OxCGRT). available www.bsg.ox.ac.uk/covidtracker (accessed 2020 6 June).
  29. 29.↵
    Ferguson NM, Laydon D, Nedjati-Gilani G et al. (2020), Imperial College COVID-19 Response Team (2020), Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand. March 16, 2020, Available: https://www.imperial.ac.uk/media/imperial-college/medicine/sph/ide/gida-fellowships/Imperial-College-COVID19-NPI-modelling-16-03-2020.pdf[Accessed May 26, 2020]
  30. 30.↵
    Ibid.
  31. 31.↵
    Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72lJ314 cases from the Chinese Center for Disease Control and Prevention. JAMA. Published online February 24, 2020. doi:10.1001/jama.2020.2648
    OpenUrlCrossRefPubMed
  32. 32.↵
    2019 Global Health Security Index, Available: https://www.ghsindex.org/ (accessed 2020 1 June)
  33. 33.↵
  34. 34.↵
    Lasry A, Kidder D, Hast M, Poovey J, Sunshine G, Zviedrite N, Ahmed F, Ethier KA. Timing of community mitigation and changes in reported COVID-19 and community mobility―four US metropolitan areas, 2020 February 26–April 1
  35. 35.↵
    Vaidya R, Herten-Crabb A, Spencer J, Moon S, Lillywhite L. Travel restrictions and infectious disease outbreaks. Journal of Travel Medicine.2020 Apr;27(3):taaa050.
    OpenUrl
  36. 36.↵
    Zhang J, Litvinova M, Wang W, Wang Y, Deng X, Chen X, Li M, Zheng W, Yi L, Chen X, Wu Q. Evolving epidemiology and transmission dynamics of coronavirus disease 2019 outside Hubei province, China: a descriptive and modelling study. The Lancet Infectious Diseases. 2020 Apr 2
  37. 37.↵
    Moshammer H, Poteser M, Lemmerer K, Wallner P, Hutter HP. Time Course of COVID-19 Cases in Austria. International Journal of Environmental Research and Public Health.2020 Jan;17(9):3270.
    OpenUrl
  38. 38.↵
    Raoofi A, Takian A, Sari AA, Olyaeemanesh A, Haghighi H, Aarabi M. COVID-19 pandemic and comparative health policy learning in Iran. Archives of Iranian Medicine. 2020 Apr 5;23(4):220–34.
    OpenUrl
  39. 39.↵
    Li HO, Bailey A, Huynh D, Chan J. YouTube as a source of information on COVID-19: a pandemic of misinformation?. BMJ Global Health. 2020 May 1;5(5):e002604.
    OpenUrlPubMed
  40. 40.↵
    Liao Q, Yuan J, Dong M, Yang L, Fielding R, Lam WW. Public Engagement and Government Responsiveness in the Communications About COVID-19 During the Early Epidemic Stage in China: Infodemiology Study on Social Media Data. Journal of Medical Internet Research. 2020;22(5):e18796.
    OpenUrlCrossRef
  41. 41.↵
    Burns A, Gutfraind A. Symptom-Based Isolation Policies: Evidence from a Mathematical Model of Outbreaks of Influenza and COVID-19. medRxiv. 2020 Jan 1.
  42. 42.↵
    El-Jardali F, Bou-Karroum L, Fadlallah R. Amplifying the role of knowledge translation platforms in the COVID-19 pandemic response. Health Research Policy and Systems.2020 June;18(1):1–7.
    OpenUrl
  43. 43.↵
    Shen C, Chen A, Luo C, Zhang J, Feng B, Liao W. Using Reports of Symptoms and Diagnoses on Social Media to Predict COVID-19 Case Counts in Mainland China: Observational Infoveillance Study. Journal of Medical Internet Research. 2020;22(5):e19421.
    OpenUrl
  44. 44.↵
    Berengueres J, Efimov D. Airline new customer tier level forecasting for real-time resource allocation of a miles program. Journal of Big Data. Published 2014 24 June; Available from: http://dx.doi.org/10.1186/2196-1115-1-3.
  45. 45.↵
    de Carvalho, R. Jackknife Euclidean / Empirical Likelihood Inference for Spearman’s Rho, 2018; Available: https://cran.r-project.org/web/packages/spearmanCI/spearmanCI.pdf
  46. 46.↵
    Jewell, NP, Lewnard, JA, Jewell, BLCaution warranted: using the Institute for Health Metrics and Evaluation model for predicting the course of the COVID-19 pandemic. 2020; Annals of Internal Medicine. Published online 2020 14 April. DOI: 10.7326/M20-1565
    OpenUrlCrossRefPubMed
  47. 47.↵
    Kirsch, TD, Moseson, H, Massaquoi, M, et al. Impact of interventions and the incidence of Ebola virus disease in Liberia-implications for future epidemics. Health policy and planning, 2017;32(2), 205–214. DOI: 10.1093/heapol/czw113
    OpenUrlCrossRefPubMed
  48. 48.↵
    Day M. Covid-19: identifying and isolating asymptomatic people helped eliminate virus in Italian village. BMJ. 2020 Mar 23;368.
  49. 49.↵
    Hale, Thomas, Noam Angrist, Beatriz Kira, Anna Petherick, Toby Phillips, Samuel Webster. “Variation in Government Responses to COVID-19” Version 6.0. Blavatnik School of Government Working Paper. May 25, 2020; Available: www.bsg.ox.ac.uk/covidtracker (accessed 1 June, 2020)
  50. 50.↵
    Jacobsen, KH (Will COVID-19 generate global preparedness?. The Lancet, 2020; 395(10229), 1013–1014.
    OpenUrl
  51. 51.↵
    Aitken, T, Chin, KL, Liew, D, Ofori-Asenso, R. Rethinking pandemic preparation: Global Health Security Index (GHSI) is predictive of COVID-19 burden, but in the opposite direction. The Journal of Infection. (published online 2020 8 May) Epub ahead of print. doi: https://dx.doi.org/10.1016%2Fj.jinf.2020.05.001
  52. 52.↵
    Kirsch, TD, Moseson, H, Massaquoi, M, et al. Op.cit.
  53. 53.↵
    Cao H, Wang J, Li Y, et al. Trend analysis of mortality rates and causes of death in children under 5 years old in Beijing, China from 1992 to 2015 and forecast of mortality into the future: an entire population based epidemiological study. BMJ Open 2017;7:e015941.
    OpenUrlAbstract/FREE Full Text
  54. 54.↵
    Chung, RY, Kim, JH, Yip, BH, et al. Alcohol tax policy and related mortality. An age-period-cohort analysis of a rapidly developed Chinese population, 1981–2010. PloS one, 2014;9(8).
  55. 55.↵
    Report of the WHO-China Joint Mission on Coronavirus Disease 2019 (COVID-19). World Health Organization; 2020; https://www.who.int/docs/default-source/coronaviruse/who-china-joint-mission-on-covid-19-final-report.pdf (accessed 17 June, 2020)
  56. 56.↵
    WHO. Pandemic Influenza Preparedness And Response - A WHO guidance document 2009; Available: https://www.who.int/influenza/preparedness/pandemic/publication/en/ (accessed 16 June, 2010)
  57. 57.↵
    WHO. Managing Epidemics: Key facts about major deadly diseases. 2018; https://apps.who.int/iris/handle/10665/272442 (accessed 16 June, 2020)
  58. 58.↵
    Scarborough P, Adhikari V, Harrington RA, Elhussein A, Briggs A, Rayner M, Adams J, Cummins S, Penney T, White M. Impact of the announcement and implementation of the UK Soft Drinks Industry Levy on sugar content, price, product size and number of available soft drinks in the UK, 2015-19: A controlled interrupted time series analysis. PLoS medicine. 2020 Feb 11;17(2):e1003025.
    OpenUrl
  59. 59.↵
    Khera R, Dharmarajan K, Wang Y, Lin Z, Bernheim SM, Wang Y, Normand SL, Krumholz HM. Association of the hospital readmissions reduction program with mortality during and after hospitalization for acute myocardial infarction, heart failure, and pneumonia. JAMA network open. 2018 Sep 7;1(5):e182777..
    OpenUrl
  60. 60.↵
    Disyatat P. Monetary policy implementation: Misconceptions and their consequences. 2008; BIS Working Papers No 269
  61. 61.↵
    Paudel NR. A critical account of policy implementation theories: status and reconsideration. Nepalese Journal of Public Policy and Governance.2009 Dec;25(2):36–54.
    OpenUrl
  62. 62.↵
    DeLeon P, DeLeon L. What ever happened to policy implementation? An alternative approach. Journal of public administration research and theory.2002 Oct;12(4):467–92.
    OpenUrlCrossRefWeb of Science
  63. 63.↵
    Kapucu N, Arslan T, Demiroz F. Collaborative emergency management and national emergency management network. Disaster prevention and management: An international journal. 2010 Aug 31.
  64. 64.↵
    Valaitis, R., MacDonald, M., Kothari, A. et al. Moving towards a new vision: implementation of a public health policy intervention. 2016; BMC Public Health 16, 412, DOI: 10.1186/s12889-016-3056-3
    OpenUrlCrossRef
  65. 65.↵
    Ansell, C. and Gash, A. (2007), “Collaborative governance in theory and practice”, Journal of Public Administration Theory and Research Advance Access, November 13, available at: http://jpart.oxfordjournals.org/cgi/content/full/mum032v1 (accessed January 30, 2008)
  66. 66.↵
    Hunter DJ, Marks L. Decision-making processes for effective policy implementation. National Institute for Health and Clinical Experience Guidance Paper http://www.nice.org.uk/niceMedia/pdf/SemRef_Decision_Hunter.pdf. 2002 May.
  67. 67.↵
    Cobey, S. Modeling infectious disease dynamics. Science. 2020; doi:10.1126/science.abb5659
    OpenUrlAbstract/FREE Full Text
Back to top
Posted November 13, 2020.
Download PDF

Supplementary Material

Data/Code
Email
Does the timing of government COVID-19 policy interventions matter? Policy analysis of an original database
M. Stephens, J. Berengueres, S. Venkatapuram, I. A. Moonesar
medRxiv 2020.11.13.20194761; doi: https://doi.org/10.1101/2020.11.13.20194761
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools

Subject Area