%0 Journal Article %A Ruth Owen %A Nawab Qizilbash %A Sara Velázquez Díaz %A José María Castellano Vázquez %A Stuart Pocock %T Making sense of non-randomized comparative treatment studies in times of Covid-19: A case study of tocilizumab %D 2021 %R 10.1101/2021.04.06.21254612 %J medRxiv %P 2021.04.06.21254612 %X BACKGROUND Tocilizumab (TCZ) is an interleukin-6 inhibitor and the second established effective drug for the treatment of hospitalized patients with Covid-19. In this study, we sought to validate the recent positive findings from the randomised clinical trial RECOVERY and to evaluate the challenges in the analysis and interpretation of non-randomized comparative effectiveness studies in Covid-19.METHODS We performed a retrospective cohort study using an openly available database of hospitalised Covid-19 patients in Spain. The primary outcome was all-cause in-hospital mortality at 28 days. We used multivariable Fine and Gray competing risk models which adjusted for both fixed and time-variant confounders to investigate the effect of TCZ on the primary outcome.RESULTS We analysed 2547 patients hospitalised with Covid-19 between 1st January and 28th June 2020. Patients in the TCZ group tended to have more severe Covid-19 at admission, as measured by biomarkers of disease severity including CRP, D-dimer and LDH. At 28 days, 91 out of 440 TCZ patients had died compared to 267 out of 2107 patients in the control group. In multivariable analysis, there was no evidence of an association between TCZ and the primary outcome (adjusted hazard ratio 1.20, 95% CI 0.86 to 1.64, P=0.26).CONCLUSIONS Our observational study failed to find a benefit of TCZ on all-cause in-hospital mortality in Covid-19 patients compared with randomized trials, highlighting the impact that unmeasured confounding and other sources of bias can have in a retrospective observational setting. For future observational studies, we recommend prospective data collection to ensure all variables have the necessary quality, completeness and timing for reliable treatment evaluation.Competing Interest StatementThe authors have declared no competing interest.Funding StatementNo external funding was received for the work presentedAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was approved by the ethics committee of HM Hospitales (approval number 20.05.1627-GHM).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesCovid Data Saves Lives is an anonymous dataset made freely available to the international medical and scientific community by HM Hospitales https://www.hmhospitales.com/coronavirus/covid-data-save-lives/english-version %U https://www.medrxiv.org/content/medrxiv/early/2021/04/07/2021.04.06.21254612.full.pdf