Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Optimal shutdown strategies for COVID-19 with economic and mortality costs: BC as a case study

M.T. Barlow, N.D. Marshall, R.C. Tyson
doi: https://doi.org/10.1101/2020.11.25.20239004
M.T. Barlow
1Department of Mathematics, University of British Columbia, Vancouver, BC V6T 1Z2, Canada ()
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: barlow@math.ubc.ca
N.D. Marshall
2Dept of Mathematics and Statistics, McGill University, 805 Sherbrooke St. West, Montreal, Quebec H3A 0B9, Canada ()
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: noah.marshall2@mail.mcgill.ca
R.C. Tyson
3CMPS Department, University of British Columbia Okanagan, 1177 Research Rd, Kelowna, BC V1V 1V7, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: rebecca.tyson@ubc.ca
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Decision makers with the responsibility of managing policy for the COVID-19 epidemic have faced difficult choices in balancing the competing claims of saving lives and the high economic cost of shutdowns. In this paper we formulate a model with both epidemiological and economic content to assist this decision making process. We consider two ways to handle the balance between economic costs and deaths. First, we use the statistical value of life, which in Canada is about C$7 million, to optimise over a single variable, which is the sum of the economic cost and the value of lives lost. Our second method is to calculate the Pareto optimal front when we look at the two variables – deaths and economic costs.

In both cases we find that, for most parameter values, the optimal policy is to adopt an initial shutdown level which reduces the reproduction number of the epidemic to close to 1. This level is then reduced once a vaccination program is underway. Our model also indicates that an oscillating policy of strict and mild shutdowns is less effective than a policy which maintains a moderate shutdown level.

1 Introduction

The COVID-19 pandemic led many countries to introduce an extensive economic and social lockdown to limit the spread of the disease (Wikipedia, 2020). While these measures are very expensive (Mandel and Veetil, 2020), in most regions where the measures were applied relatively early and with sufficient stringency, they were successful in stopping the growth of the epidemic (Moosa, 2020). After an initial period of shutdown, many jurisdictions have partially reopened their economies, and in some cases this has led to a second surge of infections (World Health Organisation, 2018) including in Canada (Grasley et al., 2020), reopening the question of whether or not to impose another lockdown.

Some kind of balance has to be struck between saving lives and the economic (and social) cost of the lockdown (Lee et al., n.d.; Miles, Stedman, and Heald, 2020). This paper presents a simple model, with both economic and epidemiological content, to help assess the options. In particular, we aim to determine what type of shutdown strategy (Xt) minimizes costs over the period of the epidemic. The data and numbers are for the Canadian province of British Columbia. We remark that any decision on the extent of the lockdown has to take many factors into account. We have chosen to express those factors which we do consider in monetary terms; inevitably this means that some important aspects will have been left out. The optimization we perform should be viewed as information that can assist in making a complex decision, rather than as a simple prescription.

We start our model at an early stage of the epidemic, corresponding roughly to the situation in B.C. in March 2020; thus we consider ‘what should have been done’ as well as ‘what should now be done’. Moving forward, we find that the minimum cost scenario does include a significant level of economic shutdown in order to ensure reduced transmission. In particular, we obtain a high level of shutdown at the beginning of the epidemic, which is monotonically decreased until the population has been vaccinated.

2 Model

Our model contains two parts: One part describing the disease dynamics, the second describing the economic costs and optimal control. We separately present each part of the model below.

2.1 Disease Dynamics

Our model for the epidemic is of standard compartmental type. For clarity, we split it into two parts. The first part is a standard SEIQ model, where S is Susceptible, E is Exposed, I is infectious and Q is Quarantined (i.e. no longer mixing with the susceptible population while infectious): Embedded Image Embedded Image Embedded Image Embedded Image

The time-dependent infectivity parameter βt depends on the amount of economic lockdown, as explained below. We initialise the model by taking Embedded Image that is, the initial number of COVID-19 carriers is split evenly between the exposed and infectious compartments.

To model the progress of patients through the medical system we separate the Q bin into smaller bins depending on quarantine state. These bins are named M, H, W, U, R, D. Here Mt is the number of patients who are mildly ill (or asymptomatic) and therefore quarantining at home, Ht and Ut are the numbers of patients in hospital (but not ICU) and ICU beds respectively, Rt is the number of recovered patients, and Dt is the number of deceased patients. These population compartments, and the connections between them, are illustrated in Figure 1.

Figure 1:
  • Download figure
  • Open in new tab
Figure 1:

The compartments of the disease model. The two dashed line boxes surround all of those compartments that are still infectious, but are no longer transmitting disease as they are quarantined at home or in hospital (the Q compartment in the model). The green arrows indicate transitions from sick states to the recovered state, while blue arrows indicate transitions from sick states to the deceased state. The variables are fractions of the total population: S = susceptible, E = exposed, I = infectious and not quarantined, M = infected but only mildly ill, H = infected and in hospital, W = infected and waiting for space to open up in hospital, U = infected and in the ICU, WU = infected and waiting for ICU space to open up, R = recovered, and D = deceased. The W individuals are assumed to be quarantined at home, while the WU individuals transition directly into the D compartment.

We wish to handle possible overload of the medical system, so we set the maximum capacity of hospital and ICU beds to be Hmax and Umax respectively. For patients needing a hospital (non-ICU) bed, we introduce the Wt compartment: The number of patients waiting for hospital beds. At time t + 1 the demand for hospital beds is Embedded Image

If demand is greater than supply, we move as many patients as possible into hospital, and the remainder go into the W container. Thus we set Embedded Image

We follow a similar procedure for the ICU patients, except that (as these patients are presumably very ill) any excess is immediately moved into the D container; we write Embedded Image for the number of these deaths. Thus, the model for the quarantined group is written Embedded Image Embedded Image Embedded Image Embedded Image Embedded Image Embedded Image

We count as excess deaths those deaths arising from overload of the health system. This consists of two terms: the number of patients who move into the D container due to ICU overload, together with the patients who move from W to D. We write DExcess for the total number of these deaths.

Note that we have assumed that everyone who becomes infectious is eventually quarantined. While this assumption is likely unrealistically optimistic, it nevertheless means that our optimal shutdown strategy will provide a lower bound. We make similarly conservative choices with regard to the parameters contributing to the infection fatality ratio.

The disease part of the model involves a substantial number of parameters. Some of these are fairly well established but many remain quite uncertain. Table 1 summarizes the values and sources.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1:

Parameter values and sources for the disease dynamics portion of the model, equations (2.1) and (2.2). † These estimated values are in line with the rates reported in Salje et al. (2020). ‡ We were unable to find data for pW D, and so we assumed that survival is very low for individuals needing the ICU but unable to access those resources.

With these parameter values the total infection fatality rate (IFR) without overload is Embedded Image which is at the low end of the range of values reported in the literature (PHAC Emerging Sciences, 2020).

2.2 Economic Costs

We now describe the economic/control part of the model. The proportion of the economy which is shut down (SD) on day t is given by Xt∈[0, xm]. Here xm < 1, as parts of the economy, e.g. food distribution, cannot be shut down. We assume that the shutdown is arranged so that the parts of the economy with the biggest effect on β are chosen first; thus we obtain a concave effectiveness from the shutdown.

Let f (x) be the proportional reduction in social contacts due to the shutdown; we call f the shutdown effectiveness function. A shutdown of Xt will lead to an infection rate on day t of Embedded Image

We do not have the data to calculate f in detail. A simple model is to take Embedded Image

(see Figure 2) where θ < 1. The reproduction number due to a SD of x is then given by

Figure 2:
  • Download figure
  • Open in new tab
Figure 2:

The shutdown effectiveness function, f (x) = xθ. The higher the value of θ, the greater is the reduction in effective reproduction number for a given level x of economic shutdown.

Embedded Image

We note that dℛ0(0+)/dx = −∞, which implies that some level of shutdown is always advantageous – see Appendix B.

With an effectiveness function of this form we need to estimate θ. A first guess would be to use the ‘Pareto principle’, which states roughly that “80% of the output is due to 20% of the input”. We thus write f (1/5) = 4/5 which gives θ≈0.14. This guess has some support from data: The fall in GDP in Canada in the first quarter of 2020 is estimated to lie between 7% and 14% (Infoline, 2020a,b; Statistics Canada, n.d.). Anderson et al. (2020, page10) estimates that the March-April 2020 shutdown in B.C. reduced contacts by about 78%, with a 90% credible interval of 66% to 89%, which reduced ℛ (x) to below 1. Using these values for GDP and contact reduction in (2.3), we obtain θ∈[0.04, 0.21]. The highest values of θ are obtained for the highest fall in GDP, and the lowest reduction in contacts. We note that the GDP estimates do not include capital destruction costs, which tend to take longer to become evident (Erken et al., 2020), and so we assume that the ultimate cost is actually higher than estimated. It therefore seems prudent to set θ at a value closer to the upper end of the plausible range. We thus select θ = 0.2 as the default value.

We write xc for the amount of SD needed to make ℛ equal to 1; thus Embedded Image

If ℛ0 = 3.3 and θ = 0.2, then xc = 0.164.

The equations above describe the evolution of the epidemic for the period t = 0, 1, …, TV once we have fixed the initial conditions and the control Xt. We take TV to be 360 days; this is the approximate time from the start of the epidemic (March 2020) until we might hope that a vaccine is available. Once a vaccine is available, supply constraints mean that it will still not be possible to vaccinate the whole population of B.C. all at once, and so some level of shutdown may still be necessary for t > TV. We assume that the vaccine is 100% effective and that NV people are vaccinated daily for each day t ≥ TV. For each day t ≥ TV we move NV people from S to R, and otherwise continue to run the model as above. We take a terminal time T = TV + N/NV for the model; at this point the whole population is vaccinated and the epidemic is at an end. In fact, herd immunity will be reached before the terminal time T (Garibaldi, E.R.Moen, and Pissarides, 2020), but some costs are likely to extend past this point, and so we take the larger terminal time as our end time. With our base parameter values we have TV = 360 and T = 610.

We now introduce costs; throughout the paper these are in Canadian dollars. The costs we consider are the economic costs of the shutdown C(SD), costs arising from the medical care of infected individuals C(M), and costs due to lives lost C(D).

The economic cost of shutdown is taken to be the daily shutdown costs summed over the time period of the the epidemic, so that writing GD to for the daily GDP of B.C. we have Embedded Image

Medical costs can be inferred from Jones (2020); we take the cost of a day in a regular hospital bed as $1,000, and ICU costs as $10,000 on the first day and $2,000 per day thereafter. The medical cost during the period t = 0, …, T is therefore Embedded Image here vM, vH, vU are the daily costs for patients in states M, H or U, vNU is the excess cost for the first day in ICU, and Embedded Image is the number of new patients in ICU on day t.

To determine costs due to the lives lost, we need to determine the ‘statistical (dollar) value of a life’ (SVL) or VL. There is a substantial literature on this topic – see Dionne and Lanoie (2004), Greenstone and Nigam (2020), and Thunström et al. (2020); authors use a variety of methods to get some handle on this number. As one would expect, estimates vary widely – the review in Dionne and Lanoie (2004) gives a range for Canada of C$2.0m – C$11.1m, with a median of C$5.5m. In 2020 dollars that is VL = C$7.0m, which we take as our base figure. We then set Embedded Image

The total cost of the epidemic is the sum of the shutdown, medical, and death costs: Embedded Image

Note that the first two of the costs in (2.6) are pure dollar costs, while the third is based on a more subjective evaluation of the dollar cost of a lost life. We use the SVL in order to estimate the total cost of the epidemic, but since the quantitative assessment of the pure dollar and SVL costs are so different, in our analysis below we also treat these two types of costs separately. We write Embedded Image

We list the economic parameters in Table 2.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2:

Economic parameters. Dollar values are in Canadian dollars. For the lost wages per day of illness, vM, we take the drop in GDP and divided by the number of days over which the drop occurred. For the number of daily vaccinations after TV, we take the population of Canada (Statistics Canada, 2020) divided by the estimated length of time it will take to vaccinate everyone (Miller and Zafar, 2020).

2.3 Optimization procedure

We considered two types of optimization. In section 3.1 we minimized the total cost of the epidemic using value of life VL to translate lost lives into costs. Since it does not always make sense to translate a lost life into a dollar value, we take a different approach in Section 3.2. There we looked at Pareto optimization (Mock, 2011) of pure dollar costs and deaths, i.e. for the two numbers (C(Dol), DT). We studied the structure of the epidemic associated with some sample points on the Pareto curve.

In both cases we only considered strategies in which Xt was held constant for a significant time period. For the total cost optimization we divided the time period into 10 equal segments of 61 days (about 2 months), and held Xt constant in each of these periods. Writing xi for the value of Xt in period i, the strategy (Xt) is described by the vector x = (x1, …, x10). We used Matlabs’s multivariate optimization routine “fmincon” to optimize over vectors x. For the Pareto optimization we used 5 equal time periods, each of 122 days (the Pareto optimisation performed poorly with 10 periods).

We had several reasons for this restriction on shutdown strategies. First, from a computational point of view, it is not feasible to optimize over several hundred control values Xi. Next, since the effectiveness function f is concave, rapidly varying control strategies will perform less well than more slowly varying control strategies (see Appendix A). Finally, as it is not realistic to consider that a government could implement a shutdown function Xt that changes too frequently.

We remark that it would be as computationally feasible to consider piecewise linear strategies as piecewise constant ones – in both cases the optimization reduces to optimizing over a 10-dimensional space (if we use our baseline setup). However, we did not consider such strategies because we did not consider them to be applicable in practice.

The two types of optimization are connected, since the total cost optimization corresponds to tangents on the Pareto curve. More precisely, write (C, D) for the two axes (dollar costs and deaths) for the Pareto curve. Let vD + C = b be a tangent to the Pareto curve at the point (C1, D1). Then b = C1 + vD1 is also the minimum total cost when we take VL = v.

3 Results

Before we consider the optimization problem in detail, it is helpful to look at the basic structure of the model described above. If the epidemic is such that there is no overload of hospital capacity, and so no excess deaths, then the total number of infected individuals is RT + DT, and the total number of deaths is Embedded Image

We can compute the expected ‘value of life’ costs as the probability of dying times the value of a lost life, i.e. VL pIFR = $33, 600, for our baseline parameter values. On the other hand, the expected medical costs are Embedded Image for the baseline parameter values. So, on average, the medical costs of the epidemic are small in comparison with the value of life costs.

3.1 Optimization of total costs

3.1.1 Baseline (constant shut down) scenarios

The simplest strategy is to take Xt = x constant for the whole period. Figure 3 shows the total cost as a function of x for various values of the SVL VL. This graph has several informative features. We consider first the curves with VL ≥ $3.0m. In these cases, the minimum value xmin is a little smaller than xc = 0.164 (if VL = $7.0m then xmin = 0.13). These values of x correspond to allowing the epidemic to grow slowly over the pre-vaccination period; it then declines once vaccination reduces the effective reproduction rate. One sees further that the minimizing value xmin is not very sensitive to VL. These values of xmin give rise to a relatively small epidemic, so any further increase in x would save relatively few lives. For x > xc the total cost curves for differing values of VL are very close together; this is because in this regime the total number of deaths is small (a few hundred), so the term VLDT is much smaller than the pure dollar cost CDol.

Figure 3:
  • Download figure
  • Open in new tab
Figure 3:

Total costs as a function of shutdown level for a constant shutdown strategy. Several values of VL (in thousands of dollars CAD) are shown.

For VL = 1.0m one sees a rather different pattern. The minimum cost is obtained at a much lower shutdown level, around 5%. In this case, deaths are counted as relatively unimportant, so the optimal strategy is to adopt a relatively mild shutdown.

3.1.2 Variable shutdown scenarios

We next consider strategies that are piecewise constant, being allowed to vary only every 61 days. We see the same general pattern as with a constant shutdown. For the baseline parameter values we find that the optimum policy (Figure 4, left plots) starts with a fairly strict shutdown, with Xt ≈ xc = 0.164, for the first six time periods. Subsequently, Xt is gradually relaxed, and is zero in the final period. Taking Xt < xc means that the epidemic grows over the first year, but at a slow and controlled rate. As vaccinations proceed, the optimum policy is to relax the shutdown enough to allow a late peak in the epidemic. This peak occurs during the period when the vaccine has become available. If the initial infection level is ten times higher than the baseline (Figure 4, right plots), we see a similar pattern, but with higher shutdown levels at the beginning, and shutdown levels dropping more in the first third of the year. Notice that in this second scenario, the optimal strategy designates Xt > xc initially, so that the epidemic decreases, bringing the case load under control before resuming the late wave pattern of the baseline case.

Figure 4:
  • Download figure
  • Open in new tab
Figure 4:

Number of infections and shutdown for optimal policy for base parameters (left) and a larger initial epidemic with I0 = E0 = 2000 (right) Need bigger axis labels!, minimizing total costs, C(Tot) (see (2.6)). For these parameter values, the critical shutdown level is Xc = 0.164. Vaccination begins at TV = 360.

The overall pattern can be characterised as a high level of shutdown at the beginning of the epidemic, with Xt decreasing in small steps at first, and then in larger steps as a vaccine becomes available. The change in Xt is monotonic: Under optimal conditions, there is no second wave. This pattern held for most of the runs we performed with modified parameters: see Table 3 for a summary of the outcomes. Increasing the number of time periods to 20 makes little difference to the total cost or number of deaths.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3:

Economic and epidemiological outcomes corresponding to the optimal solution of the model under variation of a few key parameters (left column). The Total Cost outcome includes the value of lives lost (all dollar values are in CAD). For each row in the table, all parameters except the one being varied are held at the default values listed in Tables 1 and 2. For comparison, the outcomes under default values for all of the parameters are listed in the first row.

As in the constant policy case, for VL ≤ $1.0m the optimal strategy changes to one which permits a large epidemic, with many deaths. The shutdown values for the first three periods are 0.0001, 0.0684, 0.0718. One might expect that a strategy which is the same for the final 7 periods, but is the average of the first three at the beginning (i.e. 0.0467), would perform better, but this is not the case. This modification to the optimum strategy delays the epidemic peak, but gives less social distancing when it is needed most, and allows a bigger epidemic, with 31,010 deaths as opposed to 20,477. See Figure 5.

Figure 5:
  • Download figure
  • Open in new tab
Figure 5:

Effect of a lower VL = $1.0m. Number of infections and shutdown for the optimal policy (left), and a modified control held constant at the average value of the optimal control for the first three time periods (right). The number of deaths for the optimal control is 20,477, and for the modified control is 31,010.

Figure 6:
  • Download figure
  • Open in new tab
Figure 6:

Top: Pareto plot. Each asterisk corresponds to the shutdown strategy which gives the minimum possible number of deaths Dt at dollar cost C(Dol) (recall that dollar cost does not include the value of a lost life). The Pareto front assumes default parameter values and five shutdown intervals with possibly varying levels of social distancing. Points on the Pareto front with excess deaths are red and those without are blue. The three highlighted strategies are: Do nothing (minimize costs, excluding value of life), do a some of both (try to minimize deaths and costs simultaneously), and implement severe distancing (minimize deaths). Bottom grid of plots: The cumulative cost (top row), daily infections (middle row), and daily shutdown strategy (bottom row), are shown for the epidemics associated with the three points circled in the Pareto plot (Strategies 1-3). Note that the shutdown strategy for Strategy 1 is zero (the vertical axis includes negative values - for this subplot only - so that the zero strategy line is visible.

Thus, apart from the need to control a large initial epidemic, one finds one wants Xt close to xc in the pre-vaccination phase. Taking Xt significantly smaller than xc causes a large epidemic, with many deaths, while taking Xt significantly larger than xc is economically costly, and saves few lives.

3.2 Pareto optimization: Costs and Deaths

In the results presented above, we find the optimum shutdown pattern by expressing all of the constraints, including lives lost, in terms of their monetary value, C(Tot). Here, we separate out pure dollar costs C(Dol) from deaths, applying the two as separate constraints, and present the Pareto optimum (Mock, 2011). The results are shown in Figure 3.2. The curve shows the competing effects of minimizing costs versus minimizing deaths: Minimizing the pure dollar costs of shutdown leads to higher mortality, and minimizing mortality leads to higher pure dollar costs.

Each point (x, y) on the Pareto curve corresponds to the shutdown strategy which gives the minimum possible number of deaths y at pure dollar cost x. Three of these Pareto-optimum shutdown strategies are shown in the lower half of Figure 3.2, and the Pareto points they correspond to are circled on the Pareto curve. The extreme strategies are: (Strategy 1) prioritise minimizing pure dollar costs over deaths, and (Strategy 3) prioritize minimizing deaths over costs. We also show an intermediate strategy (Strategy 2), where costs are half that of Strategy 3, but mortality is still close to the minimum.

If minimizing pure dollar costs is the highest priority (Strategy 1), then the optimal strategy is to have no economic shutdown at all, and we obtain a death toll of over 80,000 individuals. The total cost is less than $10 billion. If minimizing deaths is the highest priority (Strategy 3), we obtain a shutdown strategy with an initially high shutdown level, which then decreases at each time period until finally becoming zero at the last interval. The cost skyrockets to over $70 billion, and the number of deaths is less than 100. If, instead, we choose the intermediate strategy (Strategy 2), pure dollar costs can be reduced to near half that of the most expensive strategy, and the total deaths are a few thousand. Table 3 lists economic and epidemiology outcomes for a few additional scenarios. These results provide context to the Pareto curve in Figure 3.2. We do not see excess deaths (and a large decrease in cost) until VL drops to $1.0m or less. Increasing the frequency with which the control strategy is adjusted (i.e., increasing the number of time periods) has very little effect on any of the outcomes. In contrast, decreasing the adjustment frequency down to the point where only one constant shutdown level is used throughout the epidemic results in almost twice as many deaths and actually increases the total cost. Decreasing the shutdown efficiency θ and basic reproduction number ℛ0 both lead to reduced cost and deaths, while increasing ℛ0 and the initial disease prevalence e0 both lead to increased costs and deaths.

3.3 Sensitivity Analysis

Since some of the parameters are not well known, we test our results using a Partial Rank Correlation Coefficient (PRCC) sensitivity analysis as described by Marino et al. (2008). PRCC is a reliable measure of the contribution that parameters have to the model when the relationship between the parameter and the output is monotonic. Each parameter is varied over a range from half to twice the baseline value given in Tables 1 and 2. The PRCC values can be interpreted as the correlation between parameter and model output, linearly discounting the effects of the other parameters.

We ran the sensitivity analysis on the model with the optimal strategy given for the baseline parameters, and considered the sensitivity (a) with respect to both total costs (i.e. the sum of pure dollar and value of life costs), and (b) with respect to deaths. Both sensitivity analyses show high (greater than 0.6) sensitivity values for the parameters R0 and θ. In addition, for costs TV and NV had moderate sensitivity, in the range (0.2 to 0.6). For deaths, the parameters pH, pHD, pUD and e0 had moderate sensitivity. See the supplementary material for full details. In both cases the parameters Embedded Image had low sensitivity – less than 0.11.

It may seem somewhat surprising that VL has a relatively low sensitivity of 0.19. One reason for this is that our sensitivity analysis only studies sensitivity of a parameter x over the range [x0/2, 2x0], where x0 is our base value. Thus for VL, the sensitivity analysis only considered the range between $3.5m and $14m, and, as we already saw when we looked at constant shutdowns, in this range the value of life makes little difference to the strategy or to the total cost.

4 Discussion

Our study is motivated by the hesitation shown by some leaders to implementing strict control measures to slow the spread of COVID-19 (Haberman and Senger, 2020; Mandl and Benassatto, 2020; Maynes, 2020), in part due to the huge toll to the economy. For informed decision making, it is clear that we need some objective quantification of the total cost of both the health crisis and the economic shutdown measures. In this work, we present a coupled disease and economic cost model which is a useful tool for evaluating shutdown options. While our model is in no way a comprehensive representation of all of the costs and benefits of shutdown measures, we submit that it contains the salient features of the system, and so the patterns in our results should reflect real dynamics.

For a simple minimization it is necessary to combine our two key variables, that is the dollar cost (medical costs plus economic shutdown costs), and deaths, which we did by using the ‘value of a statistical life’ VL. For values of VL close to the consensus value of about $7.0m given in Dionne and Lanoie (2004) our results indicate that total costs (deaths, hospital costs, and deaths costs) are minimized by a significant shutdown – of about 10%-15% in the early stages of the epidemic. For these values of VL the optimal shutdown strategy decreases slowly in the initial phases of the epidemic, and then falls rapidly to nearly zero once vaccination is well underway and the system is close to herd immunity. In the middle of the vaccination phase the shutdown is relaxed sufficiently to allow a moderate late peak in infections. At this point the effective reproduction number has been reduced sufficiently so that the epidemic has no possibility to explode before the completion of the vaccination program.

If VL is taken to be $1m or less, a different pattern occurs. As death costs are smaller, economic costs play a relatively larger role, and the question is how best to deploy the relatively small amount of shutdown that will be introduced. It turns out that the optimal control is to wait until the infections are rising rapidly, and then use the shutdown to reduce the height of the epidemic peak.

In this paper we have studied the optimization problem for the situation when the disease and economic parameters are known. In practice of course this is not the case, and in particular neither of the two most significant parameters (ℛ0 and θ) would have been known to a government considering lockdowns. One therefore needs to consider strategies using feedback to control the epidemic. In the context of our model, a reasonable goal would be to aim at having the effective reproduction number Embedded Image close to 1. The results of Stewart, Van Heusden, and Dumont (2020) suggest this goal is reasonably attainable.

4.1 Gradual versus periodic shutdowns

Our observations provide an interesting perspective on the shutdown approaches taken by governments in BC and elsewhere. In almost all cases, after a severe initial shutdown, economies were reopened and it was hoped the transmission rate could be controlled through contact tracing as well as individual prophylactic behaviours (mask-wearing, washing hands, avoiding crowds, keeping business patrons 2 m (6’) apart, etc.). Unfortunately, these methods do not seem to be as effective as was hoped, and as we write (November 2020) cases are rising dramatically in many jurisdictions, and governments are reimplementing significant shutdown measures (Wikipedia, 2020). From our work, it appears that a slower and more gradual decrease in shutdown level would have led to a smaller overall cost of the epidemic.

4.2 Cost of lives lost

Since the equating of a life lost to a dollar value is debatable, we found it useful to separate pure dollar costs and deaths. The Pareto curve shows us that deaths can be maintained at a very low level, even if the shutdown level falls short of “stop the epidemic”. Again, unless it is acceptable to let the number of deaths skyrocket, the optimal shutdown strategy always includes a positive and significant (i.e. over ≈15%) level of shutdown.

In this work we use a single value for the value of life VL: that is, we do not make any adjustments for the age of the deceased. If we neglect excess deaths, then this gives a SVL cost of C0 = pIFRVL per infection; with our base parameters this is $36,400. It is natural to ask what happens if we look at an age stratified population. Mortality rates are substantially higher for older patients Salje et al. (2020), and as they have a smaller life expectancy it can be argued that their SVL should be smaller.

To assess this point, we can look at the following simple age stratified model. We divide the population into n age groups. Group i consists of a proportion ai of the population, has death rate (IFR) pi and has SVL vi. Then if we neglect excess deaths, the overall cost per infection is Embedded Image

Let vi for each age group be the life expectancy of the mid point of the age range times $170,000, which following we take to be the value of a year of life. Using the age-related death rates from Salje et al. (ibid.) and BC census data from 2011, we obtain C1 = $12, 377, i.e. about 38% of C0 = pIFRVL=$33,600. Thus the age stratified model outlined above corresponds to taking VL to be 37% of the value listed in Table 2, i.e. about $2,600,000. (See the supplementary information for more details.) The outcomes listed in Table 3 show that for VL as low as $2.0 m, the optimal shutdown strategy is sufficiently large to prevent any excess deaths, and so, broadly speaking, our results are not changed. Note that this calculation neglects excess deaths, and assumes that all the disease parameters except death rates are independent of age.

4.3 Other costs

Since our focus is the epidemic in BC, we make a few remarks about the specific situation there, namely, the overdose crisis. While our work strongly suggests that the adoption of economic shutdown measures in BC is, in the long term, a responsible strategy, the shutdown in BC has caused a significant increase in deaths due to drug overdoses there (BC Coroners Service, 2020); the excess (total overdose deaths over and above the usual average) for March through June 2020, exceeds the total number of COVID-19 deaths for that time period by over 40% (BC Centre for Disease Control, 2020; BC Coroners Service, 2020). A number of factors are likely involved in this mortality, including the disruption of regular drug supply chains, through border closures, leading to an increasingly toxic drug supply (Zussman, 2020), the reduction in access to harm reduction services as a result of physical distancing protocols (ibid.), and increased stress resulting from increased isolation and economic uncertainty (Ebrahimi, Hoffart, and Johnson, 2020; Hyland et al., 2020; Lechner et al., 2020) (similar patterns have been observed in the US (Katz, Goodnough, and Sanger-Katz, 2020)). The value of these lost lives could have a significant effect on our cost calculations, but assessing the relation between the level of economic shutdown and the number of overdose deaths is not straightforward. The social issues around the legality of drugs, addictions treatment, and overdose deaths is well beyond the scope of this paper, but is nevertheless an extremely important issue.

There are many additional costs to social distancing that have not been included in our model due to lack of data. We discuss some of the most important of these here. First, while our economic cost calculations take account of loss of wages and business income due to the shutdown, it does not include costs due to capital destruction. The Canadian Federation of Independent Business recently estimated that 12% of small and medium-sized BC businesses are at risk of closure (Gaudreault, 2020; McCusker and Tindale, 2020), but estimates of the effect of these possible closures on provincial GDP is not yet known. Second, with hospitals stretched to accommodate COVID-19 patients, and with fear of contracting COVID-19 limiting movement, treatment of non-COVID illnesses can be severely delayed (Dayal et al., 2020; Lazzerini et al., 2020). Thus there will be excess deaths from other causes, and costs associated with suffering due to untreated conditions (Dayal et al., 2020; Solis et al., 2020). Finally, mental health, in general, is known to suffer during community disasters (Lowe et al., 2019; North and Pfefferbaum, 2013), including pandemics. Research is emerging regarding the effects of COVID-19 non-pharmaceutical measures on mental health (Ebrahimi, Hoffart, and Johnson, 2020; Hyland et al., 2020; Lechner et al., 2020; Van Rheenen et al., 2020; Vinkers et al., 2020), but costs are difficult to determine at this stage.

4.4 Future considerations

Our understanding of the SARS-Cov-2 virus and COVID-19 disease are continually evolving, and so necessarily our model is relevant to the current epidemic up to a certain time point. In particular, we do not consider the possibility of a successful treatment that reduces mortality among those who become infected. There is evidence that treatment outcomes are improving for COVID-19 patients (National Institute of Health (USA), 2020), but the data are still preliminary and therefore difficult to include. We also do not include contact tracing as a measure for reducing transmission. Considerable work evaluating the effectiveness of contact tracing has been done by other researchers (Firth et al., 2020; Kucharski et al., 2020), and the general consensus is that contact tracing alone is insufficient, and can quickly become overwhelmed by a few large-scale outbreaks.

Finally, we remark that the eventual cost of the epidemic depends a great deal on the time horizon considered, and the value a society places on its elderly population (the group most at risk) (Keogh-Brown et al., 2009). Indeed, the metric used to evaluate a country’s economy is another factor that could change the calculation significantly (Marikina, 2018). These considerations are beyond the scope of the current paper, but provide interesting avenues of future work in this area, and would help countries prepare for future pandemics.

5 Conclusions

Our analysis suggests that the BC and federal governments were wise to impose severe shutdown levels at the beginning of the epidemic. The later reduction in shutdown levels was likely too large as compared to an optimal strategy. The difficulty is that people are unlikely to cooperate with rules that appear to be unnecessarily restrictive, especially when livelihoods are at stake (Bodas and Peleg, 2020; DiGiovanni et al., 2004). Future modelling studies that include behavioural components will be very helpful. Much work needs to be done by government and society to make sure that not only are countries economically prepared to handle future pandemics, but that populations also have the necessary understanding and mental resiliency to maintain a high level of prophylaxis for a long period of time.

Data Availability

No data.

Appendix A Slowly-varying SD is better when f is concave

In Section 2.3 above, we stated that slowly-varying SD strategies would outperform rapidly-varying strategies because the shutdown effectiveness function f is concave. To see this relationship, consider a strategy with period 2S, where for the first half of each period Xt ≡ x1, and Xt ≡ x2 for the second half of each period. If the xi are close enough to xc so that the epidemic does not explode over a period of S days, then an analysis of the SEIQ equation shows that the effect of the shutdown is roughly linear, so that the periodic strategy above has approximately the same effect as a constant strategy x′ with Embedded Image. As f is concave, Embedded Image and so the periodic strategy is more expensive than a constant strategy with the same effectiveness. For example, if we take Xt ≡ xc for the whole period of T days, the shutdown cost is $80.3b. If we alternate between values x1 = 0.28 and x2 = 0.09 (which satisfy Embedded Image then the shutdown cost increases to $90.3b.

Appendix B SD is non-zero

In Section 2.2 we chose the shutdown effectiveness function f (x) = xθ, with θ < 1. We now show that this implies that the optimal strategy (with respect to total costs) is non-zero. For simplicity we just treat the case when we ignore excess deaths.

In a SEIR model the final population of susceptibles S∞ satisfies (Martcheva, 2015) Embedded Image

It follows that S∞ is a differentiable function of ℛ0: write S∞ = H(ℛ0). Let us write S∞ for the final number of susceptibles if we adopt a modified strategy Xt ≡ 0, and Embedded Image for the final number if Xt ≡ x, where x is small. Then Embedded Image

Hence the modified strategy leads to a cost saving (in terms of medical and deaths costs) of Embedded Image

On the other hand, the economic cost of the modified strategy is xgDT, so writing C(T ot) and Embedded Image for the total costs of the original and modified strategies, we have Embedded Image which is positive for small enough x.

A similar analysis shows that if we consider piecewise constant strategies, the optimal strategy Xt satisfies Xt > 0 in any time period in which the initial number of infected is greater than zero.

Acknowledgements

This work was supported by (RCT) NSERC DG RGPIN-2016-05277 and (MTB) NSERC DG RGPIN-2016-03703. MTB initiated the project, and NDM wrote all of the code, ran the simulations, and wrote the first draft of the manuscript. RCT was part of the discussions throughout. MTB and RCT together wrote the final draft.

References

  1. ↵
    Anderson, S.C. et al. (2020). “Estimating the impact of COVID-19 control measures using a Bayesian model of physical distancing”. In: medRxiv. doi: https://doi.org/10.1101/2020.04.17.20070086.
  2. BC Centre for Disease Control (2020). Surveillance Report July 30, 2020. url: https://www.bccdc.ca/Health-Info-Site/Documents/BC_Surveillance_Summary_July_30_2020.pdf (visited on 07/30/2020).
  3. ↵
    BC Coroners Service (2020). Illicit Drug Toxicity January 1, 2010 - June 30, 2020. url: https://www2.gov.bc.ca/assets/gov/birth-adoption-death-marriage-and-divorce/ (visited on 07/16/2020).
  4. ↵
    Bodas, M. and K. Peleg (2020). “Self-isolation compliance in the COVID-19 era influenced by compensation: Findings from a recent survey in Israel”. In: Health Affairs 39.6, pp. 936–941.
    OpenUrl
  5. ↵
    Dayal, D. et al. (2020). “Missing during COVID-19 lockdown: Children with onset of type 1 diabetes”. In: Acta Paediatrica. doi: 10.1111/apa.15443. url: https://onlinelibrary.wildy.com/doi/epdf/10.1111/apa.15443.
    OpenUrlCrossRef
  6. ↵
    DiGiovanni, C. et al. (2004). “Factors influencing compliance with quarantine in Toronto during the 2003 SARS outbreak”. In: Biosecurity and Bioterrorism - Biodefense Strategy Practice and Science 2.4, pp. 265–272.
    OpenUrl
  7. Dionne, G. and P. Lanoie (2002). How to make a public choice about the value of a statistical life: The case of road safety. Tech. rep. Risk Management Chair Working Paper Series No. 02-02. HEC Montreal. doi: http://dx.doi.org/10.2139/ssrn.351700. xurl: https://ssrn.com/abstract=351700.
  8. — (2004). “How to make a public choice about the value of a statistical life: The case of road safety”. In: Journal of Transport Economics and Policy 38.4, pp. 247–274.
    OpenUrl
  9. ↵
    Ebrahimi, O.V., A. Hoffart, and S.U. Johnson (2020). “The mental health impact of non-pharmacological interventions aimed at impending viral transmission during the COVID-19 pandemic in a general adult population and the factors associated with adherence to these mitigation strategies”. In: preprint. doi: https://doi.org/10.31234/osf.io/kjzsp.
  10. ↵
    Erken, H. et al. (2020). Looking beyond the COVID-19 crisis. Tech. rep. Special, April 30. Rabobank. url: https://economics.rabobank.com/publications/2020/april/looking-beyond-the-covid-19-crisis/.
  11. ↵
    Firth, J.A. et al. (2020). “Using a real-world network to model localized COVID-19 control strategies”. In: Nature Medicine 26.10, pp. 1151–1160.
    OpenUrl
  12. Garibaldi, P., E.R. Moen, and C.A Pissarides (2020). “Modelling contacts and transitions in the SIR epidemics model”. In: CEPR press Covid Economics.5. url: https://www.carloalberto.org/wp-content/uploads/2020/04/garibaldi.pdf.
  13. ↵
    Gaudreault, S. (July 1, 2020). How many Canadian businesses are at risk of permanently closing due to COVID-19? Tech. rep. Research Snapshot. url: https://www.cfib-fcei.ca/sites/default/files/2020-07/research-snapshot-businesses-at-risk-of-closing.pdf.
  14. ↵
    Grasley, R. et al. (2020). Tracking the coronavirus. Date accessed: 2020-11-01. url: https://newsinteractives.cbc.ca/coronavirustracker/.
  15. ↵
    Greenstone, M. and V. Nigam (Mar. 2020). Does social distancing matter? Tech. rep. Working paper 2020-26. University of Chicago: Becker Friedman Institute. url: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3561244.
  16. ↵
    Haberman, M. and D.E. Senger (Mar. 2020). “Trump says coronavirus cure cannot ‘be worse than the problem itself’”. In: New York Times. url: https://www.nytimes.com/2020/03/23/us/politics/trump-coronavirus-restrictions.html.
  17. ↵
    Hyland, P. et al. (2020). “Anxiety and depression in the Republic of Ireland during the COVID-19 pandemic”. In: Acta Psychiatrica Scandinavica. doi: 10.111/acps.13219.
    OpenUrlCrossRef
  18. ↵
    Infoline 2020a). Gross Domestic Product. Tech. rep. 20-99. Province of British Columbia. url: https://ww2.gov.bc.ca/gov/content/data/statistics/infoline/infoline-2020/20-99-gdp.
  19. — (2020b). Gross Domestic Product. Tech. rep. 20-145. Province of British Columbia. url: https://ww2.gov.bc.ca/gov/content/data/statistics/infoline/infoline-2020/20-145-gdp.
  20. ↵
    Jones, N. (2020). “INFOGRAPHICS: How BC’s Medical Resources Stack Up”. In: The Tyee (with Hakai Magazine). url: https://thetyee.ca/News/2020/04/02/COVID-BC-Hospitals-Mapped/. (visited on 05/13/2020).
  21. ↵
    Katz, J., A. Goodnough, and M. Sanger-Katz (2020). “In shadow of pandemic, U.S. drug overdose deaths resurge to record”. In: The New York Times. url: https://www.nytimes.com/interactive/2020/07/15/upshot/drug-overdose-deaths.html (visited on 07/15/2020).
  22. ↵
    Keogh-Brown, M. et al. (2009). The possible macroeconomic impact on the UK of an influenz pandemic. Tech. rep. ISSN 1471-0498. Department of Economics, University of Oxford.
  23. ↵
    Kucharski, A.J. et al. (2020). “Effectiveness of isolation, testing, contact tracing, and physical distancing on reducing transmission of SARS-CoV-2 in different settings: a mathematical modeling study”. In: Lancet Infectious Diseases 20.10, pp. 1151–1160.
    OpenUrl
  24. ↵
    Lazzerini, M. et al. (2020). “Delayed access or provision of care in Italy resulting from fear of COVID-19”. In: Lancet 4.5, e10–e11. doi: https://doi.org/10.1016/S2352-4642(20)30108-5.
    OpenUrl
  25. ↵
    Lechner, W.V. et al. (2020). “Changes in alcohol use as a function of psychological dis-tress and social support following COVID-19 related university closings”. In: Addictive Behaviours 110.106527. doi: 10.1016/j.addbeh.2020.106527.
    OpenUrlCrossRef
  26. Lee, A. et al. (n.d.). “Should countries aim for elimination in the covid-19 pandemic?” In: British Medical Journal 370.m3410 (). doi: 10.1136/bmj.m3401.
    OpenUrlFREE Full Text
  27. ↵
    Lowe, S.R. et al. (2019). “Posttraumatic stress and depression in the aftermath of environmental disasters: A review of quantitative studies published in 2018”. In: Current Environmental Health Reports 6.4, pp. 344–360.
    OpenUrl
  28. ↵
    Mandel, A. and V.P. Veetil (2020). “The economic cost of COVID lockdowns: An out-of-equilibrium analysis”. In: SSRN: Economics of Disasters and Climate Change. doi: 10.1007/s41885-020-00066-z.
    OpenUrlCrossRef
  29. ↵
    Mandl, C. and L. Benassatto (July 2020). “Brazil’s Bolsonaro says coronavirus restrictions kill economy”. In: Reuters. url: https://www.reuters.com/article/us-health-coronavirus-brazil-idUSKCN24J0V8 (visited on 07/18/2020).
  30. ↵
    Marikina, M. (2018). “Gross domestic product or gross national happiness - which is the better alternative for economic development?” In: XVIII International Social Congress. International Scientific Conference on Economic and Social Development. Varazdin Development and Entrepreneurship Agency, pp. 188–193.
  31. ↵
    Marino, Simeone et al. (2008). “A methodology for performing global uncertainty and sensitivity analysis in systems biology”. In: Journal of Theoretical Biology 254.1, pp. 178– 196. issn: 0022-5193. doi: https://doi.org/10.1016/j.jtbi.2008.04.011.
    OpenUrl
  32. ↵
    Martcheva, M. (2015). An Introduction to Mathematical Epidemiology. Vol. 61. Texts in Applied Mathematics. Boston MA: Springer.
  33. ↵
    Maynes, C. (Oct. 2020). “Russia’s Putin says no to lockdown despite spiking COVID cases”. In: VOA. url: https://www.voanews.com/europe/russias-putin-says-no-lockdown-despite-spiking-covid-cases (visited on 10/29/2020).
  34. ↵
    McCusker, K. and K. Tindale (July 29, 2020). “One in seven small Canadian businesses risk closure during COVID-19 pandemic: survey”. In: url: https://www.citynews1130.com/2020/07/29/cfibsmall-business-closure/ (visited on 08/24/2020).
  35. ↵
    Miles, D., M. Stedman, and A. Heald (2020). “Living with COVID-19: Balancing costs against benefits in the face of the virus”. In: National Institute Economic Review 253, R60–R76. doi: 10.1017/nie.2020.30.
    OpenUrlCrossRef
  36. ↵
    Miller, A. and A. Zafar (Nov. 2020). “Why rollout of COVID-19 vaccine could be “the most difficult part” in Canada”. In: CBC news. url: https://www.cbc.ca/news/health/coronavirus-canada-covid-19-vaccine-rollout-1.5797082 (visited on 11/11/2020).
  37. ↵
    1. D.K. Chatterjee.
    Mock, W.B.T. (2011). “Pareto optimality”. In: Encyclopedia of Global Justice. Ed. by D.K. Chatterjee. Dordrecht: Springer. doi: 10.1007/978-1-4020-9160-5_341.
    OpenUrlCrossRef
  38. ↵
    Moosa, I.A. (2020). “The effectiveness of social distancing in containing Covid-19”. In: Applied Economics. doi: 10.1080/00036846.2020.1789061.
    OpenUrlCrossRef
  39. National Institute of Health (USA) (Oct. 2020). COVID-19 treatment guidelines: Therapeutic management of patients with COVID-19. url: https://www.covid19treatmentguidelines.hin.gov/therapeutic-management (visited on 10/09/2020).
  40. ↵
    North, C.S. and B. Pfefferbaum (2013). “Mental health response to community disasters: A systematic review”. In: Journal of the American Medical Association 310.5, pp. 507–518.
    OpenUrl
  41. ↵
    PHAC Emerging Sciences (July 13, 2020). COVID-19 Epidemiological and Modelling Parameters Report. Tech. rep. Report available upon request: phac.emergingsciencesecretariat-secretariatdessciencesemergentes.aspc@canada.ca. Public Health Agency of Canada.
  42. ↵
    Salje, H. et al. (2020). “Estimating the burden of SARS-CoV-2 in France”. In: Science 369, pp. 208–211.
    OpenUrl
  43. ↵
    Solis, E. et al. (May 21, 2020). “Delayed emergency surgical presentation: ipact of corona virus disease (COVID-19) on non-COVID patients”. In: ANZ Journal of Surgery. doi: 10.1111/ans.16048.
    OpenUrlCrossRef
  44. ↵
    Statistics Canada (2020). Table 17-10-0009-01 Population estimates, quarterly. doi:10.25318/1710000901-eng.
    OpenUrlCrossRef
  45. — (n.d.). Table 36-10-0434-02 Gross domestic product (GDP) at basic prices, by industry, monthly, growth rates (x 1,000,000). doi: https://doi.org/10.25318/3610043401-eng.
  46. ↵
    Stewart, G., K. Van Heusden, and G.A. Dumont (2020). “How control theory can help us control COVID-19”. In: IEEE Spectrum 57.6, pp. 22–26. url: https://spectrum.ieee.org/biomedical/diagnostics/how-control-theory-can-help-control-covid19.
    OpenUrl
  47. ↵
    Thunström, L. et al. (2020). “The benefits and costs of using social distancing to flatten the curve for COVID-19”. In: Journal of Benefit Cost Analysis 11.2, pp. 179–195. doi: https://doi.org/10.1017/bca.2020.12.
    OpenUrl
  48. Van Rheenen, T.E. et al. (2020). “Mental health status of individuals with a mood-disorder during the COVID-19 pandemic in Australia: Initial results from the COL-LATE project”. In: Journal of Affective Disorders 275, pp. 69–77. doi: 10.1016/j.jad.2020.06.037.
    OpenUrlCrossRef
  49. ↵
    Vinkers, C.H. et al. (2020). “Stress relience during the coronavirus pandemic”. In: European Neuropsychopharmacology 35, pp. 12–16.
    OpenUrl
  50. ↵
    Wikipedia (2020). COVID-19 pandemic lockdowns. url: https://en.wikipedia.org/wiki/COVID-19_pandemic_lockdowns (visited on 10/27/2020).
  51. ↵
    World Health Organisation (2018). Coronavirus Disease (COVID-19) Dashboard.Date accessed: 2020-11-01. url: https://covid19.who.int/.
  52. ↵
    Zussman, R. (2020). “B.C. overdoes deaths hit record high for second consecutive month”. In: Global News (). url: https://globalnews.ca/news/7184850/bc-overdose-numbers-record-june-2020/ (visited on 07/16/2020).
Back to top
PreviousNext
Posted November 30, 2020.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Optimal shutdown strategies for COVID-19 with economic and mortality costs: BC as a case study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Optimal shutdown strategies for COVID-19 with economic and mortality costs: BC as a case study
M.T. Barlow, N.D. Marshall, R.C. Tyson
medRxiv 2020.11.25.20239004; doi: https://doi.org/10.1101/2020.11.25.20239004
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
Optimal shutdown strategies for COVID-19 with economic and mortality costs: BC as a case study
M.T. Barlow, N.D. Marshall, R.C. Tyson
medRxiv 2020.11.25.20239004; doi: https://doi.org/10.1101/2020.11.25.20239004

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (70)
  • Allergy and Immunology (168)
  • Anesthesia (49)
  • Cardiovascular Medicine (448)
  • Dentistry and Oral Medicine (80)
  • Dermatology (55)
  • Emergency Medicine (157)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (190)
  • Epidemiology (5216)
  • Forensic Medicine (3)
  • Gastroenterology (194)
  • Genetic and Genomic Medicine (750)
  • Geriatric Medicine (77)
  • Health Economics (212)
  • Health Informatics (694)
  • Health Policy (352)
  • Health Systems and Quality Improvement (223)
  • Hematology (98)
  • HIV/AIDS (162)
  • Infectious Diseases (except HIV/AIDS) (5816)
  • Intensive Care and Critical Care Medicine (356)
  • Medical Education (102)
  • Medical Ethics (25)
  • Nephrology (80)
  • Neurology (758)
  • Nursing (43)
  • Nutrition (129)
  • Obstetrics and Gynecology (141)
  • Occupational and Environmental Health (231)
  • Oncology (475)
  • Ophthalmology (149)
  • Orthopedics (38)
  • Otolaryngology (93)
  • Pain Medicine (39)
  • Palliative Medicine (19)
  • Pathology (139)
  • Pediatrics (223)
  • Pharmacology and Therapeutics (136)
  • Primary Care Research (96)
  • Psychiatry and Clinical Psychology (854)
  • Public and Global Health (1993)
  • Radiology and Imaging (344)
  • Rehabilitation Medicine and Physical Therapy (157)
  • Respiratory Medicine (283)
  • Rheumatology (93)
  • Sexual and Reproductive Health (72)
  • Sports Medicine (75)
  • Surgery (108)
  • Toxicology (25)
  • Transplantation (29)
  • Urology (39)