ABSTRACT
Background Effects of timing of Convalescent plasma (CP) administration on hospitalized COVID-19 patients are not established.
Methods We used the National COVID Cohort Collaborative data to perform a retrospective cohort study of hospitalized COVID-19 patients in the United States between 07-01-2020 and 12-19-2020. We stratified patients based on day of CP administration (Day 0, 1, 2, 3 and 4) from COVID-19 diagnosis. We used 35 predictors to frame matched cohorts accounting for clinical and sociodemographic characteristics. We used competing risk survival models to examine the association between CP administration and length of hospital stay with in-hospital death as a competing risk performing Gray’s test on the cumulative incidence function and Cox’s regression on cause specific hazard ratios.
Results In a cohort of 4,003 hospitalized COVID-19 patients, 197 (4.9%) received CP within the first 5 days following COVID-19 diagnosis. After adjusting for potential confounding variables, there were no statistically significant associations between day of CP administration and length of hospital stay. Day 0 CP administration signallled lower mortality but was not statistically significant (HR 0.45 [0.19-1.03]).
Conclusions We found no association between the timing of CP administration and length of stay among hospitalized COVID-19 patients.
INTRODUCTION
As of April 5, 2021, 554,064 individuals have died and more than 30.5M have been infected with SARS-CoV-2, the virus that causes COVID-19, in the United States.1 Given the morbidity and mortality that the pandemic has posed, an extraordinary effort has been undertaken to identify effective treatments for COVID-19 in addition to vaccination efforts2. Among potential candidates under active investigation, there has been continued interest in the potential value of convalescent plasma (CP) given its availability from those who have recovered from COVID-19 infection. Federal Drug Administration (FDA) issued an emergency use authorization (EUA) for CP as a treatment for hospitalized COVID-19 patients on August 23, 2020.3
To better understand the potential effects of CP as a treatment for COVID-19, there have been studies in multiple countries (e.g., US, Argentina, Bahrain, China, India, Spain, The Netherlands) involving different patient populations.4-16 These studies, ranging from RCTs to observational studies, have evaluated the reduction in mortality and length of hospitalization, as well as other secondary endpoints. However the effectiveness of CP administration has been mixed in these studies. For example Gharbharan et al in their RCT reported no improvement in mortality and that by the time COVID-19 patients are hospitalized there are already neutralizing antibodies in the patients at a level comparable to donor CP. Simonovich et al and Agarwal et al in their respective RCTs also reported no difference in outcome with CP administration. In contrast Libster et al in their RCT reported improvement in disease progression. Observational studies, with or without matching, also reported conflicting results. For example Bodhiraj et al, and Liu et al, and Joyner et al observed improved outcomes from CP administration while Rogers et al and Sostin et al did not. There are several plausible reasons for differences in the conclusions drawn by these varied studies, including differences in study populations, timing of CP exposure, outcome ascertainment and statistical methods used. It is noteworthy that while some studies looked at early and late CP administration effects (Salazar et al) we were unable to find any studies that did a per-day stratification of the effect of CP administration to identify the specific effects of the timing of CP administration. This research aims to fill the knowledge gap related to timing of CP administration and COVID-19 outcomes.
In this analysis, we tested the hypothesis that CP administration reduces the duration of hospitalization in COVID-19 patients and that this reduction is dependent on the day of administration (Day 0, 1, 2, 3 and 4) of COVID-19 diagnosis. We used the National COVID Cohort Collaborative (N3C)17 data to test the hypothesis.
METHODS
N3C Data
The N3C harmonizes Electronic Health Record data for COVID-19 tested persons dating from 01/01/2018. Data from 36 medical centers were securely transferred to the N3C data enclave and harmonized into a single common model.18-19 We included patients who were diagnosed and hospitalized with COVID-19 from July 1, 2020 to December 19, 2020. As of 12/19/2020, N3C contained 2.5M total patients including 400K COVID-19 patients, 1.13B lab results, 472M drug exposures, and 185M procedures. We froze our analysis on that release to minimize confounding from COVID-19 vaccination, which began in the United States in mid-December 2020.20
Study Institutions and Patients
Figure 1 shows the population selection for this analysis and the distribution of day of CP administration as compared to COVID-19 diagnosis. Data-providers were excluded from the analysis if their data did not include specific codes or descriptions for CP data that allowed us to differentiate CP from other plasma products.21 Patients not diagnosed with COVID-19 were excluded. Patients for whom data on age or gender were missing were excluded. To focus on patients at higher risk of severe disease, we also excluded patients less than 30 years of age. Patients more than 85 years of age were excluded given the likelihood of other severe comorbidities that might have independently influenced their hospital stay and the possibility of death confounded by do-not-resuscitate, do-not intubate orders. We further restricted the analysis to patients who were hospitalized. To reduce confounding introduced by decreased COVID-19 mortality among hospitalized from March 2020 to July 2020, patients diagnosed with COVID-19 before July 1, 2020 were excluded.22 To eliminate the effect of COVID-19 vaccination in our analysis, we excluded patients diagnosed after December 19, 2020. We worked with N3C operational staff to identify a blacklist of patients from early in the COVID-19 pandemic. This blacklist methodology was required as our data access was de-identified with dates shifted +/-180 days. Thus effectively the time period of the cohort ranged from July 1, 2020 to December 19, 2020. Missing predictor data were handled using a constant value and separately a flag indicating that data were missing and as such were part of the propensity score calculation described below.23
Identification of Outcomes, Covariates and Treatment
We assessed live discharge from hospitalization, and thus hospitalization duration from treatment or in-hospital death as the two outcomes. Live discharge was determined through N3C harmonized_visit table which collates information from visit_occurrence table.18 In-hospital death was determined through the death table provided such death occurred during hospitalization.24 Covariates (i.e. predictors) were identified using OHDSI 24,25 concept sets. Treatment (CP administration) was identified by case insensitive string matching *TRANSFUSION*CONVALESCENT* device_exposure or procedure_occurrence tables.19 String matching was used as opposed to code sets because CP transfusion information was sent as free text as opposed to coded set by the subset of N3C data providers sending CP information.
Statistical Analysis
We performed multi-predictor propensity score based cohort matching to account confounding in the compared cohorts.26,27 The 26 pre-COVID-19 diagnosis predictors used to construct a propensity score model for cohort matching were: gender, age, race, geographical region, Charlson Comorbidity Index (CCI)28 categories (0, 1, 2-3, 4-5, 6+), dexamethasone, specific CCI conditions (cancer, HIV, myocardial infarction, stroke, rheumatic disease, peripheral vascular disease, renal disease, congestive heart failure), prior medical disposition (smoker, diabetic, chronic respiratory disorder, hypertensive, hyper cholesterol), prior access to medical care (through prior monthly outpatient, inpatient and ER visits, medication, procedure, hospitalization rates), BMI and data provider. We additionally used 9 Day-of-CP-Administration predictors which included minimum systolic blood pressure, minimum Glomerular Filtration Rate (GFR), minimum O2 saturation, minimum bicarbonate, maximum respiratory rate, maximum heart rate, maximum temperature, maximum C-reactive protein (CRP) and maximum erythrocyte sedimentation rate (ESR) rate. We used a Bayesian logistic model29 to have numerically stable estimates. Patients who received CP were divided into subsets that received plasma only on Day 0, 1, 2, 3 and 4 and not prior to that specified day. For each subset a cohort was created using propensity scores via nearest neighbor matching with replacement (Figure 2).27 For each cohort we performed survival analysis 30,31 using Cumulative Incidence Function (CIF)32 and followed up with Gray’s CIF equality test.33 CIF estimates the incidence of the occurrence of an event (live discharge) while taking into account competing risk (death) while Gray’s test appropriately34 determines the significance of treatment on the competing events we analyzed.30-16 For each cohort we also performed cause specific hazard ratios30 at 95% confidence interval followed up with Cox’s test.31 A hazard ratio > 1.0 indicates a beneficial effect on risk of live hospital discharge. A hazard ratio of < 1.0 indicates a beneficial effect on risk of mortality. The outcome of interest for the survival analysis was live hospital discharge with death as a competing risk. We developed Java/Python/R routines to prepare and analyze N3C data. COVID-19 diagnosis was determined through non-immunoglobulin based COVID-19 tests.
Specific Day-of-CP-Administration predictors were used as they are general markers of patient state and have been shown to be important in prediction models for COVID-19 severity and in comparative effectiveness analyses for COVID-19 therapeutics. Minimum GFR was used as a marker for renal function, minimum O2 saturation and maximum respiratory rate were used as markers of respiratory disease. Bicarbonate was used as a marker for tissue perfusion.
Maximum ESR, maximum CRP, maximum temperature, and maximum heart rate were used as markers for inflammation.35-38 Follow-up was censored at 84 days.
RESULTS
After excluding patients from providers that did not encode CP, that were age or gender, or were diagnosed with COVID-19 prior to July 1, 2020, there were 4,003 patients hospitalized with COVID-19, of whom 312 (7.7%) had received CP within 14 days of COVID-19 diagnosis (Figure 1).
In the above cohort, 197 (4.9%) received CP within Day 0, 1, 2, 3 or 4 of COVID-19 diagnosis. Multi-predictor propensity score matching based on both pre-COVID-19 predictors and
Day-of-CP-Administration predictors produced a matched comparison cohort for each treatment day. As a visual example, the predictor match for CP administered on day 0 is shown in Figure 2.
Table 1 shows the characteristics of the patients who received CP treatment and the matched cohorts for each treatment day. Overall, treated patients were predominately white (63%) and male (57%) with a mean age of 64. Of particular note is that these patients tended to be overweight or obese (mean BMI: 32kg/m^2); 44% were without prior comorbidities based on CCI, 46% were hypertensive, 37% diabetic and 12% with chronic respiratory issues. The matched cohort tracks these numbers closely overall except for day 4 which shows specifically smoker, diabetic, Charlson comorbidity predictor asymmetricity.
For each of Day 0, 1, 2, 3 and 4, we failed to detect any statistically significant reduction in hospitalization duration through both Gray’s CIF equality test and Cox’s cause-specific hazard ratio tests (Table 2 and Figure 3). For the CP-administered on day 0, the cause-specific death hazard ratio was 0.45 but this association was not significant (p-value 0.06). For the CP-administered on day 4, there was a statistically significant increased death hazard ratio (Table 2 and Figure 3) but as the cohort size (N=28) was low for the day 4 analysis, and as smoker, diabetic, Charlson comorbidity matching were asymmetric, we are unable to come to a definitive conclusion for day 4.
DISCUSSION
In this study, treatment with CP on Day 0, 1, 2, 3 and 4 of COVID-19 diagnosis demonstrated no significant effect on duration of hospitalization among COVID-19 patients. In addition to duration of hospitalization as determined by live discharge from the hospital, in-hospital deaths were also assessed in this study which also showed no association with CP treatment.
Assessment of the effectiveness of CP administration has shown mixed results across RCT and observational studies as summarized in Table 3. When comparing the results of our study with those of prior studies, following key points were observed:
Findings are consistent with 5 of the RCTs of Table 3 (Simonovich et al, Horby et al, Agarwal et al, Li et al, Gharbaran et al)
Findings are inconsistent with 1 of the RCTs (Libster et al).
Findings are consistent with two of the observational studies that performed patient matching (Rogers et al, Sostin et al)
Findings are inconsistent with two of the observational studies that performed patient (Salazar et al, Liu et al).
Findings are inconsistent with the only observational studies that did not perform patient matching (Budhiraja et al)
The Joyner et al study is not comparable as it did not compare effect of CP administration with a control group that did not receive CP
The studies with which our results are inconsistent can be further de-constructed. The Budhiraja et al study reported significant positive outcomes for patients admitted to ICU and administered CP. This ICU+CP treated cohort had 171 people over 60 years of age compared to 184 people over 60 years of age in the control cohort and a significant difference given effect of age on COVID-19 mortality.39 Additionally, the same study had 30% less people with 3+ co-morbidities in the ICU+CP treated group compared to control group which is also a significant difference given the effect of multiple co-morbidities in COVID-19 mortality.40 In Salazar et al and Liu et al the number of patients with CP included in the statistical analysis was 143 and 39, which is 27% and 80% lower than the number of patients with CP that was analyzed in our study. Finally, the Libster et al RCT was reasonably comparable between treated and untreated groups except for age where the number of people over 75 years old was 20% higher in the untreated group (N=48) as compared to the treated group (N=40) - a significant difference given effect of age on COVID-19 disease progression and mortality.39
Stratified analysis of effect of CP administration on specific days on or after COVID-19 diagnosis and the use of markers for inflammation, respiratory distress and renal function on specific CP administration days employed in this study provide an objective view into efficacy of CP treatment on duration of COVID-19 related hospitalization.
Limitations
Administration of CP was not consistently coded in the N3C data. To restrict our analysis to patients who had received CP rather than other plasma products, we excluded all data from providers without specific codes or descriptions for CP data. That restriction reduced our potential population by over 90%. While we attempted to match patient severity using 9 day of CP predictors based on data available within N3C, there could be other predictors that better represent patient status for matching purposes. Furthermore, the study could be augmented, pending data availability, with information on the oxygen device that was used during the treatment period. Another limitation is that the N3C dataset did not track whether a patient was involved in a COVID-19 vaccination trial which may skew results. This, however, is unlikely as vaccinated individuals are unlikely to be hospitalized for COVID-19 given the timeframe this analysis considered is between 07/01/2020 and 12/19/2020. Finally, while the research team considered use of titer and blood type, the analyzed N3C dataset did not contain titer levels of CP that was administered and was sparse in blood type information.
Future work
Our data do not demonstrate any clear benefit for CP administration in hospitalized patients with COVID-19 within the first 4 days of hospitalization. There was a trend towards reduced mortality for CP administered on Day 0 but a potential for increased mortality if administered on day 4. More work needs to be done to understand the possibility that earlier treatment may have a beneficial effect on COVID-19 outcomes, particularly as decades ago research pointed to similar observations41, versus the possibility that later treatment may be harmful.
Data Availability
National Institute of Health's (NIH) National COVID Cohort Collaborative (N3C) has clear procedures for researchers to gain access to the data (1000+ researchers already have access to the data) and as such the patient statistical analysis of this manuscript is transparent and repeatable. https://ncats.nih.gov/n3c provides data access request process details. Supplementary materials to this manuscript provided at https://www.ariscience.org/p3_sc2_paper_03.html include R analysis code.
COMPETING INTEREST/CONFLICTS OF INTEREST
Joy Alamgir is founder of ARIScience. Dr. Alexander is past Chair and a current member of FDA’s Peripheral and Central Nervous System Advisory Committee; is a co-founding Principal and equity holder in Monument Analytics, a health care consultancy whose clients include the life sciences industry as well as plaintiffs in opioid litigation; and is a past member of OptumRx’s National P&T Committee. Brian Garibaldi has received consulting fees from Janssen Research and Development, LLC and serves on the FDA Pulmonary-Asthma Drug Advisory Committee. This arrangement has been reviewed and approved by Johns Hopkins University in accordance with its conflict of interest policies
AUTHOR CONTRIBUTIONS
JA, SS, PK, XC wrote the first draft of the manuscript. JA, SS, MY, BG, RE, HM, CA, XC set up the statistical test design. RA, NM, BG, SB, PK, TO provided clinical input and patient severity predictor considerations and use thereof. XC wrote R code that was reviewed by JA, MY, SS. JA, SH, XC wrote data preparation code. TO, PK, CA, SB, VM, JA provided existing CP literature support. SB spurred the initial idea to look at CP within N3C. All authors reviewed and edited the manuscript. JA, XC, RE prepared tables and figures with input from other authors.
Authorship was determined using ICMJE recommendations.
AVAILABILITY OF DATA AND MATERIALS
National Institute of Health’s (NIH) National COVID Cohort Collaborative (N3C) has clear procedures for researchers to gain access to the data (1000+ researchers already have access to the data) and as such the patient statistical analysis of this manuscript is transparent and repeatable. https://ncats.nih.gov/n3c provides data access request process details. Supplementary materials to this manuscript provided at https://www.ariscience.org/p3_sc2_paper_03.html include R analysis code.
PATIENT CONSENT FOR PUBLICATION
Not Applicable
ETHICS APPROVAL AND CONSENT TO PARTICIPATE
National Institute of Health’s (NIH) National COVID Cohort Collaborative (N3C) Data Utilization Request Approval committee approved the data utilization request of this project (RP-C80011)
FUNDING
This research was partially funded by ARIScience. The N3C data project which this research utilized was funded by National Institutes of Health NCATS U24 TR002306.
Supplemental Appendix (including all R code used) is available at: https://www.ariscience.org/p3_sc2_paper_03.html
ACKNOWLEDGEMENTS
The statistical analyses we performed were conducted with data or tools accessed through the NCATS N3C Data Enclave and supported by NCATS U24 TR002306. This research was possible because of the patients whose information is included within the data and the organizations and scientists who have contributed to the on-going development of this community resource.17 This work was supported by the Intramural Research Program of the National Institutes of Health, National Cancer Institute, Division of Cancer Epidemiology and Genetics.The content of this publication and the opinions expressed do not necessarily reflect the views or policies of the Department of Health and Human Services, the National Institutes of Health or the National Cancer Institute nor does mention of trade names, commercial products, or organizations imply endorsement by the U.S. Government. We also acknowledge support from the N3C Publication Committee in the preparation of this manuscript.