Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Real-time prospective (shadow mode) validation of an AI-based clinical decision support system for predicting 3-month functional outcome in acute stroke: the VALIDATE study protocol

Marta Rubiera, Martin Bendszus, Ronen R. Leker, Adam Hilbert, Ingo Werren, Luis M. Lopez-Ramos, Mercedes Ayesta, Thi Nguyet Que Nguyen, Sussane Bonekamp, Victoria Sala, Hamza Jubran, Claudia Meza, Fatma Shalabi, Yoel Schwartzmann, David Cano, Malte von Tottleben, John Kelleher, Dietmar Frey, the VALIDATE investigators
doi: https://doi.org/10.64898/2026.04.26.26350937
Marta Rubiera
1Hospital Universitari Vall d’Hebron, Stroke Unit, Barcelona, Spain;
2Vall d’Hebron Institut de Recerca, Stroke Research Group, Barcelona, Spain
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: martaaurora.rubiera{at}vallhebron.cat
Martin Bendszus
3University of Heidelberg, Department of Neuroradiology, Heidelberg, Germany
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ronen R. Leker
4Hebrew University Hadassah Medical School, Department of Neurology, Yerushalayim, Israel
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adam Hilbert
5Charité Universitätsmedizin, Charité Lab for Artificial Intelligence in Medicine (CLAIM), Berlin, Germany
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ingo Werren
6IBM iX GmbH, Digital Health Department, Berlin, Germany
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Luis M. Lopez-Ramos
7Simula Metropolitan Center for Digital Engineering, Oslo, Norway; Rey Juan Carlos University – Fuenlabrada School of Engineering, Fuenlabrada, Spain
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mercedes Ayesta
8NORA Health, Sant Cugat, Spain
RN
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thi Nguyet Que Nguyen
9Technological University Dublin, Dublin, Ireland
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sussane Bonekamp
3University of Heidelberg, Department of Neuroradiology, Heidelberg, Germany
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Victoria Sala
2Vall d’Hebron Institut de Recerca, Stroke Research Group, Barcelona, Spain
RN
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hamza Jubran
4Hebrew University Hadassah Medical School, Department of Neurology, Yerushalayim, Israel
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Claudia Meza
2Vall d’Hebron Institut de Recerca, Stroke Research Group, Barcelona, Spain
RN
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fatma Shalabi
4Hebrew University Hadassah Medical School, Department of Neurology, Yerushalayim, Israel
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yoel Schwartzmann
4Hebrew University Hadassah Medical School, Department of Neurology, Yerushalayim, Israel
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Cano
8NORA Health, Sant Cugat, Spain
DS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Malte von Tottleben
10Empirica Gesellschaft für Kommunikations- und Technologieforschung mbH, Digital Health, Bonn, Germany
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John Kelleher
11Trinity College, ADAPT Research Centre, School of Computer Science and Statistics, Dublin, Ireland
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dietmar Frey
5Charité Universitätsmedizin, Charité Lab for Artificial Intelligence in Medicine (CLAIM), Berlin, Germany
12Department of Neurosurgery, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Germany
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Introduction Despite the proven benefits of reperfusion therapies in acute ischemic stroke, treatment decisions in the hyperacute phase remain complex and are rarely supported by individualized outcome predictions. Artificial intelligence (AI)-based clinical decision support systems (CDSS) offer potential real-time prognostic estimates, but prospective evidence of their feasibility and performance in routine clinical workflows is limited. Our aim is to prospectively evaluate real-time feasibility, usability, and predictive performance of an AI-based CDSS (VALIDATE-CDSS) for individualized outcome prediction in acute stroke care.

Methods and analysis Prospective, multicenter, observational study enrolling consecutive patients with acute ischemic stroke presenting to three tertiary stroke centers. Clinical management will follow standard practice at the discretion of treating physicians. In parallel, a dedicated researcher will collect patient data in real time and input them into the VALIDATE-CDSS using a mobile application, operating in shadow mode without influencing clinical decisions. The system will generate individualized predictions of 3-month functional outcome (modified Rankin Scale) for four treatment strategies (intravenous thrombolysis, endovascular thrombectomy, combined therapy, or no reperfusion) at three sequential time points: baseline clinical data, non-contrast CT, and CT angiography.

The primary outcome is the real-world feasibility and usability of the VALIDATE-CDSS in the hyperacute stroke workflow. Secondary outcomes include predictive performance, agreement between model-suggested and actual treatments, incremental value with increasing data availability, and assessment of potential bias across predefined subgroups. This study will provide prospective real-world evidence on the implementation and clinical potential of AI-based decision support for personalized treatment selection in acute ischemic stroke

Ethics and dissemination Patient enrollment began after approval from the ethics committees of all participating centers. Results will be disseminated through peer-reviewed open-access journals and conference presentations. Following open science principles, anonymized data and metadata will be made publicly available in the Zenodo repository upon study completion.

Trial registration ClinicalTrials.gov (NCT05622539).

Strengths and limitations of this study

  • - First study to assess the feasibility of integrating an outcome-predictor CDSS into real-life hyperacute stroke workflows, addressing a critical gap between AI model development and clinical implementation

  • - Multicenter, prospective observational time-motion shadow-mode design, which minimizes interference with standard care while capturing real-world operational data

  • - Validation of a locked AI model developed from independent retrospective multicenter datasets across different populations, reducing the risk of overfitting to local case-mix

  • - Real-time data acquisition in the emergency department poses a significant operational challenge, with potential for missing or delayed inputs that may affect model performance in practice

  • - Risk of bias cannot be excluded, including spectrum bias from non-anticipated subgroups, temporal drift in clinical practice or patient populations, and centre-level variation in workflow and data quality

Competing Interest Statement

Dr Rubiera reported compensation from Bayer for data and safety monitoring services outside the present work. Dr. Lecker received speaker honoraria from IschemaView, Boehringer Ingelheim, Pfizer, Jansen, Biogen, Medtronic and Abbott and advisory board honoraria from Jansen, all outside the submitted work The remaining authors report no disclosures related to the present work.

Clinical Trial

NCT05622539

Clinical Protocols

https://zenodo.org/records/17367485

Funding Statement

This work was supported by the European Commission Horizon Europe Programme grant number 101057263

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Vall Hebron Institut de Recerca gave ethical approval for this work (PR(AG)432-2023); Universitaet Heidelberg Ethikkommission der Med. Fakultaet gave ethical approval for this work (S-687/2023) and Helsinki Committee (Institutional Review Board) of Hadassah Medical Center-Ein Kerem gave ethical approval for this work (HMO-0529-22)

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

Results will be disseminated through peer-reviewed open-access journals and conference presentations. In line with open science principles, anonymized data and metadata will be made publicly available in the Zenodo repository upon study completion. The analytical code will be available after the future publication of the algorithms.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted April 27, 2026.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Real-time prospective (shadow mode) validation of an AI-based clinical decision support system for predicting 3-month functional outcome in acute stroke: the VALIDATE study protocol
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Real-time prospective (shadow mode) validation of an AI-based clinical decision support system for predicting 3-month functional outcome in acute stroke: the VALIDATE study protocol
Marta Rubiera, Martin Bendszus, Ronen R. Leker, Adam Hilbert, Ingo Werren, Luis M. Lopez-Ramos, Mercedes Ayesta, Thi Nguyet Que Nguyen, Sussane Bonekamp, Victoria Sala, Hamza Jubran, Claudia Meza, Fatma Shalabi, Yoel Schwartzmann, David Cano, Malte von Tottleben, John Kelleher, Dietmar Frey, the VALIDATE investigators
medRxiv 2026.04.26.26350937; doi: https://doi.org/10.64898/2026.04.26.26350937
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Real-time prospective (shadow mode) validation of an AI-based clinical decision support system for predicting 3-month functional outcome in acute stroke: the VALIDATE study protocol
Marta Rubiera, Martin Bendszus, Ronen R. Leker, Adam Hilbert, Ingo Werren, Luis M. Lopez-Ramos, Mercedes Ayesta, Thi Nguyet Que Nguyen, Sussane Bonekamp, Victoria Sala, Hamza Jubran, Claudia Meza, Fatma Shalabi, Yoel Schwartzmann, David Cano, Malte von Tottleben, John Kelleher, Dietmar Frey, the VALIDATE investigators
medRxiv 2026.04.26.26350937; doi: https://doi.org/10.64898/2026.04.26.26350937

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neurology
Subject Areas
All Articles
  • Addiction Medicine (576)
  • Allergy and Immunology (867)
  • Anesthesia (306)
  • Cardiovascular Medicine (4480)
  • Dentistry and Oral Medicine (449)
  • Dermatology (385)
  • Emergency Medicine (614)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1528)
  • Epidemiology (15275)
  • Forensic Medicine (31)
  • Gastroenterology (1133)
  • Genetic and Genomic Medicine (6643)
  • Geriatric Medicine (671)
  • Health Economics (1006)
  • Health Informatics (4602)
  • Health Policy (1378)
  • Health Systems and Quality Improvement (1622)
  • Hematology (544)
  • HIV/AIDS (1275)
  • Infectious Diseases (except HIV/AIDS) (15959)
  • Intensive Care and Critical Care Medicine (1110)
  • Medical Education (626)
  • Medical Ethics (147)
  • Nephrology (674)
  • Neurology (6691)
  • Nursing (346)
  • Nutrition (1006)
  • Obstetrics and Gynecology (1152)
  • Occupational and Environmental Health (961)
  • Oncology (3369)
  • Ophthalmology (988)
  • Orthopedics (370)
  • Otolaryngology (421)
  • Pain Medicine (437)
  • Palliative Medicine (131)
  • Pathology (668)
  • Pediatrics (1703)
  • Pharmacology and Therapeutics (699)
  • Primary Care Research (717)
  • Psychiatry and Clinical Psychology (5494)
  • Public and Global Health (9284)
  • Radiology and Imaging (2223)
  • Rehabilitation Medicine and Physical Therapy (1375)
  • Respiratory Medicine (1201)
  • Rheumatology (598)
  • Sexual and Reproductive Health (720)
  • Sports Medicine (535)
  • Surgery (720)
  • Toxicology (100)
  • Transplantation (290)
  • Urology (266)