Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Quantifying Treatment Effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial

View ORCID ProfileAndrew A. Lover
doi: https://doi.org/10.1101/2020.03.22.20040949
Andrew A. Lover
Department of Biostatistics and Epidemiology, University of Massachusetts- Amherst, Amherst, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Andrew A. Lover
  • For correspondence: alover@umass.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Human infections with a novel coronavirus (SARS-CoV-2) were first identified via syndromic surveillance in December of 2019 in Wuhan China. Since identification, infections (coronavirus disease-2019; COVID-19) caused by this novel pathogen have spread globally, with more than 250,000 confirmed cases as of March 21, 2020. An open-label clinical trial has just concluded, suggesting improved resolution of viremia with use of two existing therapies: hydroxychloroquine (HCQ) as monotherapy, and in combination with azithromycin (HCQ-AZ). [1, 2].

The results of this important trial have major implications for global policy in the rapid scale-up and response to this pandemic. The authors present results with p-values for differences in proportions between the study arms, but their analysis is not able to provide effect size estimates.

To address this gap, more modern analytical methods including survival models, have been applied to these data, and show modest to no impact of HCQ treatment, with more significant effects from the HCQ-AZ combination, potentially suggesting a role for co-infections in COVID-19 pathogenesis.

The trial of Gautret and colleagues, with consideration of the effect sizes, and p-values from multiple models, does not provide sufficient evidence to support wide-scale rollout of HCQ monotherapy for the treatment of COVID-19; larger randomzied studies should be considered. However, these data do suggest further study of HCQ-AZ combination therapy should be prioritized as rapidly as possible.

1 Introduction

Evidence-based public health programming is essential for global pandemic planning, and optimization of resources. However, unadjusted analyses may provide distorted estimates, or not full utilize scarce clinical data, especially in with consideration of intention-to-treat analyses, where all persons enrolled are analysed [3, 4]. Finally, effect size estimates allow for the magnitude of potential clinical impact to considered in policy adoption, as statistical significance may not be biologically important [5].

2 Data and Analysis

All analyses was performed using Stata 16.1 (College Station, TX, USA). Standard 95% confidence interval were used; model parsimony was assessed using Akaike and Bayesian information criteria (AIC/BIC). All models were adjusted for age and sex. Assessing the predictive power of logistic models used Tjur’s Embedded Image [6].

2.1 Data source

Data were obtained from [2], and the Supplemental Table 1 was digitized using Tabula software, with subsequent hand-validation. Data for the six patients who were lost-to-follow-up (LTF) were manually entered into a database.

2.2 Primary outcome

The primary outcome as reported by the authors “The primary endpoint was virological clearance at day-6 post-inclusion.” An optimal analysis for this endpoints in a binary regression which avoids many of the potential biases in logistic models when outcomes are common [7].

2.3 Secondary outcome

The stated “Secondary endpoint was virological clearance overtime during the study period.” and standard Cox survival time models and Royston-Parmar flexible parameteric models [8] were used to capture the time-to-first negative PCR (with a Ct threshold of >=35). The incorporation of the censored patients was as per standard methods.

3 Results

The sequence of confirmed viremia via PCR is shown in (Fig. 1), and the LFT patients are at the bottom of the figure.

Figure 1:
  • Download figure
  • Open in new tab
Figure 1:

Sequence plot of enrolled patients. (N= 42).

Figure 2:
  • Download figure
  • Open in new tab
Figure 2:

Unadjusted Kaplan-Meier plot of all enrolled patients (N= 42).

The primary outcome was assessed using binary regressions to provide relative risks for clearance of viremia between the study arms. The main effect of interest (that of all combined HCQ-treated patients versus control), shows a marginally significant risk ratio of 3.84 (95 % CI 1.02 - 14.42, p= 0.047). Analysis of the separate HCQ and HCQ+AZ outcome was not possible due to quasi-separation of the model.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1:

Risk ratios for clearance of virema, by day six, using binary regression (Primary outcome). (N=30).

To address the limitations of these models, Firth penalized-likelihood model were used, which deal well with separation and quasi-separation. [9]

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2:

Odds ratios for clearance of viremia, by day six, from a Firth penalized likelihood regression (Primary outcome). (N=30).

To assess the secondary outcome, Kaplan-Meier and Cox models were use initially to compare the time-to-event with adjustment for covariates. Due severe proportional hazard violations in the HCQ-AZ group, flexible parametric models were used to estimate effects.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3:

Hazard ratios for time-to-first negative PCR, using flexible parametric models. (N=36). (Secondary Outcome)

4 Discussion and Conclusions

Together these results, especially in consideration of the loss to followup of six patients, do not provide sufficient evidence to support HCQ monotherapy for the treatment of COVID-19.

This analysis is not without limitations: interpretation of the presented dataset may be incorrect; the analysis models for the primary and secondary outcome endpoints is inferred from the original authors’ description and power calcualtions (case-control design); and not all covariates were available in the original data [10].

However, taken together, this analysis does suggest further studies of HCQ-AZ combination therapy should be prioritized with great haste. The rapid increase in confirmed infections within the last few days suggests that the pandemic is accelerating, and there are major opportunity costs associated with all choices [11]; and rapid science will be critical for progress [12].

Data Availability

Data sources, statistical code, and supporting documents are available here: https://github.com/andrewlover/HCQ_AZ_COVID_19

Revision History

View this table:
  • View inline
  • View popup
  • Download powerpoint

Footnotes

  • ↵* https://www.umass.edu/sphhs/person/faculty/andrew-lover

References

  1. [1].↵
    Hydroxychloroquine and azithromycin as a treatment of COVID-19 – IHU. Library Catalog: www.mediterranee-infection.com.
  2. [2].↵
    Philippe Gautret, Jean Christophe Lagier, Philippe Parola, Van Thuan Hoang, Line Medded, Morgan Mailhe, Barbara Doudier, Johan Courjon, Valerie Giordanengo, Vera ESTEVES Vieira, Herve TISSOT Dupont, Stephane Honore, Philippe Colson, Eric Chabriere, Bernard LA Scola, Jean Marc Rolain, Philippe Brouqui, and Didier Raoult. Hydroxychloroquine and Azithromycin as a treatment of COVID-19: preliminary results of an open-label non-randomized clinical trial. medRxiv, page 2020.03.16.20037135, March 2020. Publisher: Cold Spring Harbor Laboratory Press.
  3. [3].↵
    Ian R White, Nicholas J Horton, James Carpenter, Stuart J Pocock, et al. Strategy for intention to treat analysis in randomised trials with missing outcome data. Bmj, 342:d40, 2011.
    OpenUrlFREE Full Text
  4. [4].↵
    Sandeep K Gupta. Intention-to-treat concept: a review. Perspectives in clinical research, 2(3):109, 2011.
    OpenUrlCrossRefPubMed
  5. [5].↵
    Shinichi Nakagawa and Innes C Cuthill. Effect size, confidence interval and statistical significance: a practical guide for biologists. Biological reviews, 82(4):591–605, 2007.
    OpenUrlCrossRefPubMed
  6. [6].↵
    Tue Tjur. Coefficients of determination in logistic regression models—a new proposal: The coefficient of discrimination. The American Statistician, 63(4):366–372, 2009.
    OpenUrlCrossRefWeb of Science
  7. [7].↵
    Louise-Anne McNutt, Chuntao Wu, Xiaonan Xue, and Jean Paul Hafner. Estimating the relative risk in cohort studies and clinical trials of common outcomes. American journal of epidemiology, 157(10):940–943, 2003.
    OpenUrlCrossRefPubMedWeb of Science
  8. [8].↵
    Patrick Royston and Mahesh KB Parmar. Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects. Statistics in medicine, 21(15):2175–2197, 2002.
    OpenUrlCrossRefPubMedWeb of Science
  9. [9].↵
    Joseph Coveney. Firthlogit: Stata module to calculate bias reduction in logistic regression. 2015.
  10. [10].↵
    Caitlin Rivers, Jean-Paul Chretien, Steven Riley, Julie A Pavlin, Alexandra Woodward, David Brett-Major, Irina Maljkovic Berry, Lindsay Morton, Richard G Jarman, Matthew Biggerstaff, et al. Using “outbreak science” to strengthen the use of models during epidemics. Nature Communications, 10(1):1–3, 2019.
    OpenUrl
  11. [11].↵
    Theo Lorenc and Kathryn Oliver. Adverse effects of public health interventions: a conceptual framework. J Epidemiol Community Health, 68(3):288–290, 2014.
    OpenUrlAbstract/FREE Full Text
  12. [12].↵
    Michael A Johansson, Nicholas G Reich, Lauren Ancel Meyers, and Marc Lipsitch. Preprints: An underutilized mechanism to accelerate outbreak science. PLoS medicine, 15(4), 2018.
Back to top
PreviousNext
Posted March 27, 2020.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Quantifying Treatment Effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Quantifying Treatment Effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial
Andrew A. Lover
medRxiv 2020.03.22.20040949; doi: https://doi.org/10.1101/2020.03.22.20040949
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Quantifying Treatment Effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial
Andrew A. Lover
medRxiv 2020.03.22.20040949; doi: https://doi.org/10.1101/2020.03.22.20040949

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (179)
  • Allergy and Immunology (434)
  • Anesthesia (99)
  • Cardiovascular Medicine (948)
  • Dentistry and Oral Medicine (178)
  • Dermatology (110)
  • Emergency Medicine (260)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (422)
  • Epidemiology (8989)
  • Forensic Medicine (4)
  • Gastroenterology (420)
  • Genetic and Genomic Medicine (1959)
  • Geriatric Medicine (190)
  • Health Economics (402)
  • Health Informatics (1329)
  • Health Policy (660)
  • Health Systems and Quality Improvement (519)
  • Hematology (212)
  • HIV/AIDS (420)
  • Infectious Diseases (except HIV/AIDS) (10809)
  • Intensive Care and Critical Care Medicine (575)
  • Medical Education (200)
  • Medical Ethics (54)
  • Nephrology (222)
  • Neurology (1830)
  • Nursing (110)
  • Nutrition (274)
  • Obstetrics and Gynecology (353)
  • Occupational and Environmental Health (470)
  • Oncology (999)
  • Ophthalmology (298)
  • Orthopedics (111)
  • Otolaryngology (182)
  • Pain Medicine (126)
  • Palliative Medicine (44)
  • Pathology (265)
  • Pediatrics (580)
  • Pharmacology and Therapeutics (276)
  • Primary Care Research (234)
  • Psychiatry and Clinical Psychology (1904)
  • Public and Global Health (4123)
  • Radiology and Imaging (676)
  • Rehabilitation Medicine and Physical Therapy (368)
  • Respiratory Medicine (549)
  • Rheumatology (225)
  • Sexual and Reproductive Health (191)
  • Sports Medicine (177)
  • Surgery (207)
  • Toxicology (39)
  • Transplantation (109)
  • Urology (81)