Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

iSPAN: Improved prediction of outcomes post thrombectomy with Machine Learning

View ORCID ProfileBrendan S Kelly, Prateek Mathur, John Duignan, View ORCID ProfileSarah Power, Edward H Lee, Yuhao Huang, View ORCID ProfileSilvia D Vaca, View ORCID ProfileLaura M Prolo, View ORCID ProfileKristen W Yeom, Aonghus Lawlor, Ronan P Killeen
doi: https://doi.org/10.1101/2023.04.17.23288611
Brendan S Kelly
1St Vincent’s University Hospital, Dublin, Ireland
2Insight Centre for Data Analytics, UCD, Dublin, Ireland
3Wellcome Trust – HRB, Irish Clinical Academic Training, Dublin, Ireland
4School of Medicine, University College Dublin, Dublin, Ireland
5Beaumont Hospital, Dublin, Ireland
6Lucille Packard Children’s Hospital at Stanford, Stanford, CA, USA
MB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Brendan S Kelly
  • For correspondence: brendanskelly@me.com
Prateek Mathur
2Insight Centre for Data Analytics, UCD, Dublin, Ireland
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John Duignan
6Lucille Packard Children’s Hospital at Stanford, Stanford, CA, USA
MB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sarah Power
MB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sarah Power
Edward H Lee
6Lucille Packard Children’s Hospital at Stanford, Stanford, CA, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yuhao Huang
6Lucille Packard Children’s Hospital at Stanford, Stanford, CA, USA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Silvia D Vaca
6Lucille Packard Children’s Hospital at Stanford, Stanford, CA, USA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Silvia D Vaca
Laura M Prolo
6Lucille Packard Children’s Hospital at Stanford, Stanford, CA, USA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Laura M Prolo
Kristen W Yeom
6Lucille Packard Children’s Hospital at Stanford, Stanford, CA, USA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kristen W Yeom
Aonghus Lawlor
2Insight Centre for Data Analytics, UCD, Dublin, Ireland
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ronan P Killeen
1St Vincent’s University Hospital, Dublin, Ireland
MB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Background This study aimed to develop and evaluate a machine learning model and a novel clinical score for predicting outcomes in stroke patients undergoing endovascular thrombectomy.

Methods This retrospective study included all patients aged over 18 years with an anterior circulation stroke treated at a thrombectomy centre from 2010 to 2020. External validation data was obtained. The primary outcome variable was day 90 mRS ≥3. Existing clinical scores (SPAN and PRE) and Machine Learning (ML) models were compared. A novel clinical score (iSPAN) was derived by adding an optimised weighting of the most important ML features to the SPAN and compared results.

Results 812 patients were initially included (397 female, average age 73), 62 for external validation. The best performing clinical score and ML model were SPAN and XGBoost (sensitivity specificity and accuracy 0.967, 0.290, 0.628 and 0.783, 0.693, 0.738 respectively). A significant difference was found overall and XGBoost was more accurate than SPAN (p< 0.0018). The most important features were Age, mTICI and total number of passes. The addition of 11 points for mTICI of ≤ 2B and ≥ 3 points for 3 passes to the SPAN achieved the best accuracy and was used to create the iSPAN. iSPAN was not significantly less accurate than XGBoost (p>0.5). In the external validation set, iSPAN and SPAN achieved sensitivity, specificity, and accuracy of (0.735, 0.862, 0.79) and (0.471, 0.897, 0.67), respectively.

Conclusions iSPAN incorporates machine-derived features to achieve better predictions compared to existing scores. It is not inferior to the XGB model and is externally generalisable.

Key Points

  • An XGB model performed better than existing scores and other tested models for prognostication post EVT.

  • It identified mTICI and number of passes as important and modifiable factors.

  • Integrating these into the SPAN score (iSPAN) was not inferior to the XGB model and is generalisable and easier to use and interpret.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This work was performed within the Irish Clinical Academic Training (ICAT) Programme, supported by the Wellcome Trust and the Health Research Board (Grant No. 203930/B/16/Z), the Health Service Executive National Doctors Training and Planning and the Health and Social Care, Research and Development Division, Northern Ireland and the Faculty of Radiologists, Royal College of Surgeons in Ireland. This research was supported by Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/2289_P2.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Ethics committee/IRB of Beaumont Hospital waived ethical approval for this work

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Footnotes

  • Funding This work was performed within the Irish Clinical Academic Training (ICAT) Programme, supported by the Wellcome Trust and the Health Research Board (Grant No. 203930/B/16/Z), the Health Service Executive National Doctors Training and Planning and the Health and Social Care, Research and Development Division, Northern Ireland and the Faculty of Radiologists, Royal College of Surgeons in Ireland. This research was supported by Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/2289_P2.

Data Availability

Data available on reasonable request

  • Non standard abbreviations

    (AI)
    Artificial Intelligence
    (EVT)
    Endovascular thrombectomy
    (XGB)
    eXtreme Gradient Boosting
    (KNN)
    K-Nearest Neighbour
    (SVM)
    Support Vector Machine
    (ML)
    Machine Learning
    (MLP)
    Multilayer Perceptron
    (SPAN)
    Stroke Prediction using Age and NIHSS
    (our funders)
    The added “I” in iSPAN refers to Improved, artificial Intelligence, Insight (our research centre), and the ICAT programme
    (PRE)
    Pittsburgh Response to Endovascular therapy
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
    Back to top
    PreviousNext
    Posted April 24, 2023.
    Download PDF
    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    iSPAN: Improved prediction of outcomes post thrombectomy with Machine Learning
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    iSPAN: Improved prediction of outcomes post thrombectomy with Machine Learning
    Brendan S Kelly, Prateek Mathur, John Duignan, Sarah Power, Edward H Lee, Yuhao Huang, Silvia D Vaca, Laura M Prolo, Kristen W Yeom, Aonghus Lawlor, Ronan P Killeen
    medRxiv 2023.04.17.23288611; doi: https://doi.org/10.1101/2023.04.17.23288611
    Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    iSPAN: Improved prediction of outcomes post thrombectomy with Machine Learning
    Brendan S Kelly, Prateek Mathur, John Duignan, Sarah Power, Edward H Lee, Yuhao Huang, Silvia D Vaca, Laura M Prolo, Kristen W Yeom, Aonghus Lawlor, Ronan P Killeen
    medRxiv 2023.04.17.23288611; doi: https://doi.org/10.1101/2023.04.17.23288611

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Radiology and Imaging
    Subject Areas
    All Articles
    • Addiction Medicine (270)
    • Allergy and Immunology (552)
    • Anesthesia (135)
    • Cardiovascular Medicine (1757)
    • Dentistry and Oral Medicine (238)
    • Dermatology (173)
    • Emergency Medicine (312)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (658)
    • Epidemiology (10798)
    • Forensic Medicine (8)
    • Gastroenterology (589)
    • Genetic and Genomic Medicine (2947)
    • Geriatric Medicine (287)
    • Health Economics (534)
    • Health Informatics (1927)
    • Health Policy (836)
    • Health Systems and Quality Improvement (745)
    • Hematology (291)
    • HIV/AIDS (630)
    • Infectious Diseases (except HIV/AIDS) (12515)
    • Intensive Care and Critical Care Medicine (688)
    • Medical Education (299)
    • Medical Ethics (86)
    • Nephrology (324)
    • Neurology (2798)
    • Nursing (151)
    • Nutrition (433)
    • Obstetrics and Gynecology (559)
    • Occupational and Environmental Health (597)
    • Oncology (1464)
    • Ophthalmology (444)
    • Orthopedics (172)
    • Otolaryngology (255)
    • Pain Medicine (190)
    • Palliative Medicine (56)
    • Pathology (381)
    • Pediatrics (866)
    • Pharmacology and Therapeutics (366)
    • Primary Care Research (337)
    • Psychiatry and Clinical Psychology (2639)
    • Public and Global Health (5364)
    • Radiology and Imaging (1012)
    • Rehabilitation Medicine and Physical Therapy (595)
    • Respiratory Medicine (726)
    • Rheumatology (330)
    • Sexual and Reproductive Health (289)
    • Sports Medicine (279)
    • Surgery (327)
    • Toxicology (47)
    • Transplantation (150)
    • Urology (125)