Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Development and validation of patient-level prediction models for adverse outcomes following total knee arthroplasty

Ross D. Williams, Jenna M. Reps, Anthony G. Sena, Edward Burn, Ying He, Daniel R. Morales, David Culliford, Dahai Yu, Victoria Y. Strauss, Talita Duarte-Salles, Albert Prats-Uribe, Antonella Delmestri, James Weaver, William Sproviero, Danielle Robinson, Henry Morgan Stewart, Belay Birlie, Rafael Pinedo-Villanueva, Spyros Kolovos, Luis H. John, Ruth E. Costello, Michel van Speybroeck, Caroline O’Leary, Evan Minty, Thomas Falconer, Alison Callahan, Stephen Pfohl, Theresa Burkard, Jennifer Lane, Peter R. Rijnbeek, Patrick B. Ryan, Daniel Prieto-Alhambra
doi: https://doi.org/10.1101/2020.12.14.20240994
Ross D. Williams
1Erasmus University Medical Centre, Rotterdam
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jenna M. Reps
2Janssen Research and Development, Raritan, NJ, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anthony G. Sena
1Erasmus University Medical Centre, Rotterdam
2Janssen Research and Development, Raritan, NJ, USA
BA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Edward Burn
3NDORMS, University of Oxford, Oxford, UK
7Fundació Institut Universitari per a la recerca a l’Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), Barcelona, Spain
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ying He
3NDORMS, University of Oxford, Oxford, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel R. Morales
4University of Dundee, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Culliford
5NIHR Applied Research Collaboration Wessex, University of Southampton, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dahai Yu
6Keele University, Keele, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Victoria Y. Strauss
3NDORMS, University of Oxford, Oxford, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Talita Duarte-Salles
7Fundació Institut Universitari per a la recerca a l’Atenció Primària de Salut Jordi Gol i Gurina (IDIAPJGol), Barcelona, Spain
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Albert Prats-Uribe
3NDORMS, University of Oxford, Oxford, UK
MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Antonella Delmestri
3NDORMS, University of Oxford, Oxford, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
James Weaver
2Janssen Research and Development, Raritan, NJ, USA
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William Sproviero
8Department of Psychiatry, University of Oxford, Oxford, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Danielle Robinson
3NDORMS, University of Oxford, Oxford, UK
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Henry Morgan Stewart
9IQVIA, London, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Belay Birlie
10Centre for Epidemiology Versus Arthritis, School of Biological Sciences, Faculty of Biology, Medicine and Health, The University of Manchester, Manchester, UK
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rafael Pinedo-Villanueva
3NDORMS, University of Oxford, Oxford, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Spyros Kolovos
3NDORMS, University of Oxford, Oxford, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Luis H. John
1Erasmus University Medical Centre, Rotterdam
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ruth E. Costello
10Centre for Epidemiology Versus Arthritis, School of Biological Sciences, Faculty of Biology, Medicine and Health, The University of Manchester, Manchester, UK
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michel van Speybroeck
11Janssen Pharmaceutica, Beerse, Belgium
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caroline O’Leary
9IQVIA, London, UK
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Evan Minty
12O’Brien Institute of Public Health, Faculty of Medicine, University of Calgary, Alberta, Canada
MD MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas Falconer
13Department of Biomedical Informatics, Columbia University Medical Center
MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alison Callahan
14Center for Biomedical Informatics Research, School of Medicine, Stanford University, Stanford, California, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephen Pfohl
14Center for Biomedical Informatics Research, School of Medicine, Stanford University, Stanford, California, USA
BS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Theresa Burkard
15University of Basel, Switzerland
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jennifer Lane
3NDORMS, University of Oxford, Oxford, UK
MEd MRCS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter R. Rijnbeek
1Erasmus University Medical Centre, Rotterdam
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Patrick B. Ryan
2Janssen Research and Development, Raritan, NJ, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel Prieto-Alhambra
3NDORMS, University of Oxford, Oxford, UK
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: daniel.prietoalhambra@ndorms.ox.ac.uk
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Elective total knee replacement (TKR) is a safe and cost-effective surgical procedure for treating severe knee osteoarthritis (OA). Although complications following surgery are rare, prediction tools could help identify those patients who are at particularly high risk who could then be targeted with preventative interventions. We aimed to develop a simple model to help inform treatment choices.

Methods We trained and externally validated adverse event prediction models for patients with TKR using electronic health records (EHR) and claims data from the US (OPTUM, CCAE, MDCR, and MDCD) and general practice data in the UK (IQVIA Medical Research Database ([IMRD], incorporating data from The Health Improvement Network [THIN], a Cegedim database). The target population consisted of patients undergoing a primary TKR, aged ≥40 years and registered in any of the contributing data sources for ≥1 year before surgery. LASSO logistic regression models were developed for four adverse outcomes: post-operative (90-day) mortality, venous thromboembolism (VTE), readmission, and long-term (5-year) revision surgery. A second model was developed with a reduced feature set to increase interpretability and usability.

Findings A total of 508,082 patients were included, with sample size per data source ranging from 1,853 to 158,549 patients. Overall, 90-day mortality, VTE, and readmission prevalence occurred in a range of 0.20%-0.32%, 1.7%-3.0% and 2.2%-4.8%, respectively. Five-year revision surgery was observed in 1.5%-3.1% of patients. The full model predicting 90-day mortality yielded AUROC of 0.78 when trained in OPTUM and yielded an AUROC of 0.70 when externally validated on THIN. We then developed a 12 variable model which achieved internal AUROC of 0.77 and external AUROC of 0.71 in THIN. The discriminative performances of the models predicting 90-day VTE, readmission, and 5-year revision were consistently poor across the datasets (AUROC<0.7).

Interpretation We developed and externally validated a simple prediction model based on sex, age, and 10 comorbidities that can identify patients at high risk of short-term mortality following TKR. Our model had a greater discriminative ability than the Charlson Comorbidity Index in predicting 90-day mortality. The 12-feature mortality model is easily implemented and the performance suggests it could be used to inform evidence based shared decision-making prior to surgery and for appropriate precautions to be taken for those at high risk. The other outcomes examined had low performance.

Funding This activity under the European Health Data & Evidence Network (EHDEN) has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No 806968. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and EFPIA. The sponsor of the study did not have any involvement in the writing of the manuscript or the decision to submit it for publication. The research was supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). DPA is funded by a National Institute for Health Research Clinician Scientist award (CS-2013-13-012). TDS is funded by the Department of Health of the Generalitat de Catalunya under the Strategic Plan for Research and Innovation in Health (PERIS; SLT002/16/00308). The views expressed in this publication are those of the authors and not those of the NHS, the National Institute for Health Research or the Department of Health. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication.

Question Is it possible to predict adverse events following total knee replacement?

Findings Mortality was the only adverse event studied that we were able to predict with adequate performance. We produced a 12 variable prediction model for 90-day post-operative mortality that achieved an AUROC of 0.77 on internal test validation (Optum) and 0.71 when externally validated in THIN. The model also showed adequate calibration.

Meaning Patients can now be presented with an accurate risk assessment for short term mortality such that they are well-informed before the decision for surgery is taken.

Importance Total Knee Replacement is generally a safe, effective procedure that is performed on thousands of patients each year. However, a small number of those patients will experience adverse events. Due to the surgery’s elective nature, a well calibrated, high performing risk model could pre-emptively inform the patient and clinician decision making process and help to guide preventative treatment.

Competing Interest Statement

Competing interests All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: AS, JW, JR, MvS and PBR are full-time employees of Janssen Research & Development, a pharmaceutical company of Johnson & Johnson, and shareholders in Johnson & Johnson. The Johnson & Johnson family of companies also includes DePuy Synthes, which is the maker of medical devices for joint reconstruction. DPA reports grants from Amgen, grants from UCB Biopharma, grants from Les Laboratoires Servier, outside the submitted work. CO is a part-time employee of IQVIA.

Funding Statement

This activity under the European Health Data & Evidence Network (EHDEN) has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No 806968. This Joint Undertaking receives support from the European Union's Horizon 2020 research and innovation programme and EFPIA. The sponsor of the study did not have any involvement in the writing of the manuscript or the decision to submit it for publication. The research was supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). DPA is funded by a National Institute for Health Research Clinician Scientist award (CS-2013-13-012). TDS is funded by the Department of Health of the Generalitat de Catalunya under the Strategic Plan for Research and Innovation in Health (PERIS; SLT002/16/00308). The views expressed in this publication are those of the authors and not those of the NHS, the National Institute for Health Research or the Department of Health. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The THIN data collection was approved by the NHS South-East Multi-centre Research Ethics Committee (MREC) in 2003. Under the terms of this ethics approval, studies using pre-collected, pseudonymised data must undergo scientific review to help ensure appropriate analysis and interpretation of the data. The independent Scientific Review Committee (SRC), which was set up in July 2009, provided approval for the use of the THIN data for the current study (18THIN100). For the US databases, the New England Institutional Review Board (IRB) determined the study to be exempt from broad IRB approval, as this research project did not involve human subject research.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Due to patient privacy concerns no patient level data is available however all aggregated results have been made available

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted December 15, 2020.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Development and validation of patient-level prediction models for adverse outcomes following total knee arthroplasty
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Development and validation of patient-level prediction models for adverse outcomes following total knee arthroplasty
Ross D. Williams, Jenna M. Reps, Anthony G. Sena, Edward Burn, Ying He, Daniel R. Morales, David Culliford, Dahai Yu, Victoria Y. Strauss, Talita Duarte-Salles, Albert Prats-Uribe, Antonella Delmestri, James Weaver, William Sproviero, Danielle Robinson, Henry Morgan Stewart, Belay Birlie, Rafael Pinedo-Villanueva, Spyros Kolovos, Luis H. John, Ruth E. Costello, Michel van Speybroeck, Caroline O’Leary, Evan Minty, Thomas Falconer, Alison Callahan, Stephen Pfohl, Theresa Burkard, Jennifer Lane, Peter R. Rijnbeek, Patrick B. Ryan, Daniel Prieto-Alhambra
medRxiv 2020.12.14.20240994; doi: https://doi.org/10.1101/2020.12.14.20240994
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Development and validation of patient-level prediction models for adverse outcomes following total knee arthroplasty
Ross D. Williams, Jenna M. Reps, Anthony G. Sena, Edward Burn, Ying He, Daniel R. Morales, David Culliford, Dahai Yu, Victoria Y. Strauss, Talita Duarte-Salles, Albert Prats-Uribe, Antonella Delmestri, James Weaver, William Sproviero, Danielle Robinson, Henry Morgan Stewart, Belay Birlie, Rafael Pinedo-Villanueva, Spyros Kolovos, Luis H. John, Ruth E. Costello, Michel van Speybroeck, Caroline O’Leary, Evan Minty, Thomas Falconer, Alison Callahan, Stephen Pfohl, Theresa Burkard, Jennifer Lane, Peter R. Rijnbeek, Patrick B. Ryan, Daniel Prieto-Alhambra
medRxiv 2020.12.14.20240994; doi: https://doi.org/10.1101/2020.12.14.20240994

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (271)
  • Allergy and Immunology (553)
  • Anesthesia (135)
  • Cardiovascular Medicine (1761)
  • Dentistry and Oral Medicine (238)
  • Dermatology (173)
  • Emergency Medicine (312)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (660)
  • Epidemiology (10803)
  • Forensic Medicine (8)
  • Gastroenterology (592)
  • Genetic and Genomic Medicine (2952)
  • Geriatric Medicine (287)
  • Health Economics (534)
  • Health Informatics (1930)
  • Health Policy (836)
  • Health Systems and Quality Improvement (745)
  • Hematology (293)
  • HIV/AIDS (631)
  • Infectious Diseases (except HIV/AIDS) (12519)
  • Intensive Care and Critical Care Medicine (693)
  • Medical Education (299)
  • Medical Ethics (86)
  • Nephrology (324)
  • Neurology (2801)
  • Nursing (151)
  • Nutrition (433)
  • Obstetrics and Gynecology (559)
  • Occupational and Environmental Health (597)
  • Oncology (1469)
  • Ophthalmology (444)
  • Orthopedics (172)
  • Otolaryngology (257)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (381)
  • Pediatrics (867)
  • Pharmacology and Therapeutics (366)
  • Primary Care Research (337)
  • Psychiatry and Clinical Psychology (2641)
  • Public and Global Health (5374)
  • Radiology and Imaging (1013)
  • Rehabilitation Medicine and Physical Therapy (596)
  • Respiratory Medicine (726)
  • Rheumatology (330)
  • Sexual and Reproductive Health (289)
  • Sports Medicine (279)
  • Surgery (327)
  • Toxicology (47)
  • Transplantation (150)
  • Urology (125)