Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Quantifying treatment effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial

View ORCID ProfileAndrew A. Lover
doi: https://doi.org/10.1101/2020.03.22.20040949
Andrew A. Lover
Department of Biostatistics and Epidemiology, University of Massachusetts-Amherst, Amherst, MA,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Andrew A. Lover
  • For correspondence: alover@umass.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Human infections with a novel coronavirus (SARS-CoV-2) were first identified via syndromic surveillance in December of 2019 in Wuhan China. Since identification, infections (coronavirus disease-2019; COVID-19) caused by this novel pathogen have spread globally, with more than 250,000 confirmed cases as of March 21, 2020. An open-label clinical trial has just concluded, suggesting improved resolution of viremia with use of two existing therapies: hydroxychloroquine (HCQ) as monotherapy, and in combination with azithromycin (HCQ-AZ). [3, 4].

The results of this important trial have major implications for global policy in the rapid scale-up and response to this pandemic. The authors present results with p-values for differences in proportions between the study arms, but their analysis is not able to provide effect size estimates.

To address this gap, more modern analytical methods including survival models, have been applied to these data, and show modest to no impact of HCQ treatment, with more significant effects from the HCQ-AZ combination, potentially suggesting a role for co-infections in COVID-19 pathogenesis.

The trial of Gautret and colleagues, with consideration of the effect sizes, and p-values from multiple models, does not provide sufficient evidence to support wide-scale rollout of HCQ monotherapy for the treatment of COVID-19; larger randomized studies should be considered. These data also suggest further randomized-controlled studies of HCQ-AZ combination therapy should be undertaken.

1 Introduction

Evidence-based public health programming is essential for global pandemic planning, and optimization of resources. However, unadjusted analyses may provide distorted estimates, or not full utilize scarce clinical data, especially in with consideration of intention-to-treat analyses, where all persons enrolled are analysed [5, 6]. Finally, effect size estimates allow for the magnitude of potential clinical impact to considered in policy adoption, as statistical significance may not be biologically important [7].

2 Data and Analysis

All analyses was performed using Stata 16.1 (College Station, TX, USA). Standard 95% confidence interval were used; model parsimony was assessed using Akaike and Bayesian information criteria (AIC/BIC). All models were adjusted for age and sex. Assessing the predictive power of logistic models used Tjur’s Embedded Image. [8].

2.1 Data source

Data were obtained from [4], and the Supplemental Table 1 was digitized using Tabula software, with subsequent hand-validation. Data for the six patients who were lost-to-follow-up (LTF) were manually entered into a database.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1: Risk ratios for clearance of virema, by day six, using binary regression (Primary outcome). (N=30).
View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2:

Odds ratios for clearance of viremia, by day six, from a Firth penalized likelihood regression (Primary outcome). (N=30).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3:

Hazard ratios for time-to-first negative PCR, using flexible parametric models. (N=36). (Secondary Outcome)

2.2 Primary outcome

The primary outcome as reported by the authors “The primary endpoint was virological clearance at day-6 post-inclusion.” An optimal analysis for this endpoints in a binary regression which avoids many of the potential biases in logistic models when outcomes are common [9].

2.3 Secondary outcome

The stated “Secondary endpoint was virological clearance overtime during the study period.” and standard Cox survival time models and Royston-Parmar flexible parameteric models [10] were used to capture the time-to-first negative PCR (with a Ct threshold of >=35). The incorporation of the censored patients was as per standard methods.

3 Results

The sequence of confirmed viremia via PCR is shown in (Fig. 1), and the LFT patients are at the bottom of the figure. The primary outcome was assessed using binary regressions to provide relative risks for clearance of viremia between the study arms. The main effect of interest (that of all combined HCQ-treated patients versus control), shows a marginally significant risk ratio of 3.84 (95 % CI 1.02 - 14.42, p= 0.047). Analysis of the separate HCQ and HCQ+AZ outcome was not possible due to quasi-separation of the model.

Figure 1:
  • Download figure
  • Open in new tab
Figure 1: Sequence plot of enrolled patients. (N= 42).
Figure 2:
  • Download figure
  • Open in new tab
Figure 2: Unadjusted Kaplan-Meier plot of all enrolled patients (N= 42).

To address the limitations of these models, Firth penalized-likelihood model were used, which deal well with separation and quasi-separation. [11]

To assess the secondary outcome, Kaplan-Meier and Cox models were use initially to compare the time-to-event with adjustment for covariates. Due severe proportional hazard violations in the HCQ-AZ group, flexible parametric models were used to estimate effects.

4 Discussion and Conclusions

Together these results, especially in consideration of the loss to followup of six patients, do not provide sufficient evidence to support HCQ monotherapy for the treatment of COVID-19.

This analysis is not without limitations: interpretation of the presented dataset may be incorrect; the analysis models for the primary and secondary outcome endpoints is inferred from the original authors’ description and power calcualtions (case-control design); and not all covariates were available in the original data [12].

However, taken together, this analysis does suggest further studies of HCQ-AZ combination therapy should be prioritized with great haste. The rapid increase in confirmed infections within the last few days suggests that the pandemic is accelerating, and there are major opportunity costs associated with all choices [13]; and rapid science will be critical for progress [14].

Data Availability

Data sources, statistical code, and supporting documents are available here: https://github.com/andrewlover/HCQ_AZ_COVID_19

Revision History

View this table:
  • View inline
  • View popup
  • Download powerpoint

Footnotes

  • ↵* https://www.umass.edu/sphhs/person/faculty/andrew-lover

  • The author stands by all analytical and statistical aspects of this preprint. However, subsequent to this analysis, further details of the original study have been released-with major uncertainties in study design, reporting, choice of endpoints, and most importantly, data integrity [1, 2]. Therefore, all results from the original study should be viewed with considerable skepticism.

References

  1. [1].↵
    Elisabeth Bik. Thoughts on the Gautret et al. paper about Hydroxychloroquine and Azithromycin treatment of COVID-19 infections. Technical report, March 2020. Library Catalog: scienceintegritydigest.com.
  2. [2].↵
    Pubpeer. Pubpeer: Hydroxychloroquine and Azithromycin as a treatment of COVID-19: preliminary results of an open-label non-randomized clinical trial, March 2020.
  3. [3].↵
    Hydroxychloroquine and azithromycin as a treatment of COVID-19 – IHU. Library Catalog: www.mediterranee-infection.com.
  4. [4].↵
    Philippe Gautret, Jean Christophe Lagier, Philippe Parola, Van Thuan Hoang, Line Medded, Morgan Mailhe, Barbara Doudier, Johan Courjon, Valerie Giordanengo, Vera ESTEVES Vieira, Herve TISSOT Dupont, Stephane Honore, Philippe Colson, Eric Chabriere, Bernard LA Scola, Jean Marc Rolain, Philippe Brouqui, and Didier Raoult. Hydroxychloroquine and Azithromycin as a treatment of COVID-19: preliminary results of an open-label non-randomized clinical trial. medRxiv, page doi:2020.03.16.20037135, March 2020. Publisher: Cold Spring Harbor Laboratory Press.
    OpenUrlCrossRef
  5. [5].↵
    Ian R White, Nicholas J Horton, James Carpenter, Stuart J Pocock, et al. Strategy for intention to treat analysis in randomised trials with missing outcome data. Bmj, 342:d40, 2011.
    OpenUrlFREE Full Text
  6. [6].↵
    Sandeep K Gupta. Intention-to-treat concept: a review. Perspectives in clinical research, 2(3):109, 2011.
    OpenUrlCrossRefPubMed
  7. [7].↵
    Shinichi Nakagawa and Innes C Cuthill. Effect size, confidence interval and statistical significance: a practical guide for biologists. Biological reviews, 82(4):591–605, 2007.
    OpenUrlCrossRefPubMed
  8. [8].↵
    Tue Tjur. Coefficients of determination in logistic regression models—a new proposal: The coefficient of discrimination. The American Statistician, 63(4):366–372, 2009.
    OpenUrlCrossRefWeb of Science
  9. [9].↵
    Louise-Anne McNutt, Chuntao Wu, Xiaonan Xue, and Jean Paul Hafner. Estimating the relative risk in cohort studies and clinical trials of common outcomes. American journal of epidemiology, 157(10):940–943, 2003.
    OpenUrlCrossRefPubMedWeb of Science
  10. [10].↵
    Patrick Royston and Mahesh KB Parmar. Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects. Statistics in medicine, 21(15):2175–2197, 2002.
    OpenUrlCrossRefPubMedWeb of Science
  11. [11].↵
    Joseph Coveney. Firthlogit: Stata module to calculate bias reduction in logistic regression. 2015.
  12. [12].↵
    Caitlin Rivers, Jean-Paul Chretien, Steven Riley, Julie A Pavlin, Alexandra Woodward, David Brett-Major, Irina Maljkovic Berry, Lindsay Morton, Richard G Jarman, Matthew Biggerstaff, et al. Using “outbreak science” to strengthen the use of models during epidemics. Nature Communications, 10(1):1–3, 2019.
    OpenUrl
  13. [13].↵
    Theo Lorenc and Kathryn Oliver. Adverse effects of public health interventions: a conceptual framework. J Epidemiol Community Health, 68(3):288–290, 2014.
    OpenUrlAbstract/FREE Full Text
  14. [14].↵
    Michael A Johansson, Nicholas G Reich, Lauren Ancel Meyers, and Marc Lipsitch. Preprints: An underutilized mechanism to accelerate outbreak science. PLoS medicine, 15(4), 2018.
View Abstract
Back to top
PreviousNext
Posted April 10, 2020.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Quantifying treatment effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Quantifying treatment effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial
Andrew A. Lover
medRxiv 2020.03.22.20040949; doi: https://doi.org/10.1101/2020.03.22.20040949
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
Quantifying treatment effects of hydroxychloroquine and azithromycin for COVID-19: a secondary analysis of an open label non-randomized clinical trial
Andrew A. Lover
medRxiv 2020.03.22.20040949; doi: https://doi.org/10.1101/2020.03.22.20040949

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (62)
  • Allergy and Immunology (141)
  • Anesthesia (44)
  • Cardiovascular Medicine (408)
  • Dentistry and Oral Medicine (67)
  • Dermatology (47)
  • Emergency Medicine (141)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (171)
  • Epidemiology (4809)
  • Forensic Medicine (3)
  • Gastroenterology (177)
  • Genetic and Genomic Medicine (670)
  • Geriatric Medicine (70)
  • Health Economics (187)
  • Health Informatics (621)
  • Health Policy (314)
  • Health Systems and Quality Improvement (200)
  • Hematology (84)
  • HIV/AIDS (155)
  • Infectious Diseases (except HIV/AIDS) (5279)
  • Intensive Care and Critical Care Medicine (325)
  • Medical Education (91)
  • Medical Ethics (24)
  • Nephrology (73)
  • Neurology (677)
  • Nursing (41)
  • Nutrition (110)
  • Obstetrics and Gynecology (124)
  • Occupational and Environmental Health (203)
  • Oncology (437)
  • Ophthalmology (138)
  • Orthopedics (36)
  • Otolaryngology (88)
  • Pain Medicine (35)
  • Palliative Medicine (15)
  • Pathology (127)
  • Pediatrics (193)
  • Pharmacology and Therapeutics (129)
  • Primary Care Research (84)
  • Psychiatry and Clinical Psychology (766)
  • Public and Global Health (1796)
  • Radiology and Imaging (321)
  • Rehabilitation Medicine and Physical Therapy (138)
  • Respiratory Medicine (255)
  • Rheumatology (86)
  • Sexual and Reproductive Health (68)
  • Sports Medicine (61)
  • Surgery (100)
  • Toxicology (23)
  • Transplantation (28)
  • Urology (37)