Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

A multi-modal vision knowledge graph of cardiovascular disease

View ORCID ProfileKhaled Rjoob, View ORCID ProfileKathryn A McGurk, View ORCID ProfileSean L Zheng, View ORCID ProfileLara Curran, Mahmoud Ibrahim, Lingyao Zeng, Vladislav Kim, View ORCID ProfileShamin Tahasildar, View ORCID ProfileSoodeh Kalaie, View ORCID ProfileDeva S Senevirathne, View ORCID ProfileParisa Gifani, View ORCID ProfileVladimir Losev, View ORCID ProfileJin Zheng, Wenjia Bai, View ORCID ProfileAntonio de Marvao, View ORCID ProfileJames S Ware, Christian Bender, View ORCID ProfileDeclan P O’Regan
doi: https://doi.org/10.1101/2025.07.17.25331359
Khaled Rjoob
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Khaled Rjoob
Kathryn A McGurk
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
2National Heart and Lung Institute, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kathryn A McGurk
Sean L Zheng
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
2National Heart and Lung Institute, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sean L Zheng
Lara Curran
2National Heart and Lung Institute, Imperial College London, London, UK
3Royal Brompton Hospital, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lara Curran
Mahmoud Ibrahim
4Bayer AG, Research & Development, Pharmaceuticals, Wuppertal, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lingyao Zeng
4Bayer AG, Research & Development, Pharmaceuticals, Wuppertal, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vladislav Kim
4Bayer AG, Research & Development, Pharmaceuticals, Wuppertal, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shamin Tahasildar
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Shamin Tahasildar
Soodeh Kalaie
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
5Department of Computing, Department of Brain Sciences and Data Science Institute, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Soodeh Kalaie
Deva S Senevirathne
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Deva S Senevirathne
Parisa Gifani
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Parisa Gifani
Vladimir Losev
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Vladimir Losev
Jin Zheng
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jin Zheng
Wenjia Bai
5Department of Computing, Department of Brain Sciences and Data Science Institute, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Antonio de Marvao
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
6British Heart Foundation Centre of Research Excellence, School of Cardiovascular and Metabolic Medicine and Sciences, King’s College London, London, UK
7Department of Women and Children’s Health, King’s College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Antonio de Marvao
James S Ware
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
2National Heart and Lung Institute, Imperial College London, London, UK
3Royal Brompton Hospital, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for James S Ware
Christian Bender
4Bayer AG, Research & Development, Pharmaceuticals, Wuppertal, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Declan P O’Regan
1MRC Laboratory of Medical Sciences, Imperial College London, Hammersmith Hospital Campus, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Declan P O’Regan
  • For correspondence: declan.oregan{at}imperial.ac.uk
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Understanding gene-disease associations is important for uncovering pathological mechanisms and identifying potential therapeutic targets. Knowledge graphs offer a powerful solution for representing and integrating data from multiple biomedical sources, but lack individual-level information on target organ structure and function. Here we developed CardioKG, a knowledge graph integrating over 200,000 computer vision-derived cardiovascular phenotypes from biomedical images with data extracted from 18 diverse biological databases modelling over a million relationships. A variational graph auto-encoder was used to generate node embeddings from the knowledge graph, which were used as input features to predict gene-disease associations, assess druggability and propose drug repurposing strategies. The model predicted new genetic associations and therapeutic strategies for leading causes of cardiovascular disease which were also associated with improved survival. Candidate therapies included methotrexate for heart failure and gliptins for atrial fibrillation. Imaging enhanced the ability to leverage biological data for pathway discovery. These capabilities represent an important step toward using biomedical imaging to enhance graph-structured models for identifying treatable disease mechanisms.

Competing Interest Statement

D.P.O'R. receives research support from Bayer AG and Calico Labs, and is a paid consultant to Bayer AG and Bristol Myers Squibb. J.S.W. has received research support from Bristol Myers Squibb, has acted as a paid advisor to Health Lumen, Tenaya Therapeutics, and Solid Biosciences, and is a founder with equity in Saturnus Bio.

Funding Statement

The study was supported by the Medical Research Council (MC_UP_1605/13); the British Heart Foundation (RG/F/24/110138, RE/24/130023, CH/F/24/90015, FS/IPBSRF/22/27059); Bayer AG, and the National Institute for Health Research (NIHR) Imperial College Biomedical Research Centre. D.P.OR. is supported by the British Heart Foundation Big Beat Challenge award to CureHeart (BBC/F/21/220106).

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study received ethical approval from the National Research Ethics Service (11/NW/0382), and all participants gave written informed consent.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data availability

The scripts for data analysis are publicly available at https://github.com/ImperialCollegeLondon/cardioKG (DOI:10.5281/zenodo.16025952). Data from UK Biobank are available for approved research.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted July 18, 2025.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A multi-modal vision knowledge graph of cardiovascular disease
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A multi-modal vision knowledge graph of cardiovascular disease
Khaled Rjoob, Kathryn A McGurk, Sean L Zheng, Lara Curran, Mahmoud Ibrahim, Lingyao Zeng, Vladislav Kim, Shamin Tahasildar, Soodeh Kalaie, Deva S Senevirathne, Parisa Gifani, Vladimir Losev, Jin Zheng, Wenjia Bai, Antonio de Marvao, James S Ware, Christian Bender, Declan P O’Regan
medRxiv 2025.07.17.25331359; doi: https://doi.org/10.1101/2025.07.17.25331359
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
A multi-modal vision knowledge graph of cardiovascular disease
Khaled Rjoob, Kathryn A McGurk, Sean L Zheng, Lara Curran, Mahmoud Ibrahim, Lingyao Zeng, Vladislav Kim, Shamin Tahasildar, Soodeh Kalaie, Deva S Senevirathne, Parisa Gifani, Vladimir Losev, Jin Zheng, Wenjia Bai, Antonio de Marvao, James S Ware, Christian Bender, Declan P O’Regan
medRxiv 2025.07.17.25331359; doi: https://doi.org/10.1101/2025.07.17.25331359

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Cardiovascular Medicine
Subject Areas
All Articles
  • Addiction Medicine (576)
  • Allergy and Immunology (868)
  • Anesthesia (306)
  • Cardiovascular Medicine (4483)
  • Dentistry and Oral Medicine (449)
  • Dermatology (385)
  • Emergency Medicine (615)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1528)
  • Epidemiology (15283)
  • Forensic Medicine (31)
  • Gastroenterology (1134)
  • Genetic and Genomic Medicine (6651)
  • Geriatric Medicine (671)
  • Health Economics (1006)
  • Health Informatics (4606)
  • Health Policy (1378)
  • Health Systems and Quality Improvement (1624)
  • Hematology (545)
  • HIV/AIDS (1276)
  • Infectious Diseases (except HIV/AIDS) (15965)
  • Intensive Care and Critical Care Medicine (1111)
  • Medical Education (626)
  • Medical Ethics (147)
  • Nephrology (675)
  • Neurology (6699)
  • Nursing (346)
  • Nutrition (1006)
  • Obstetrics and Gynecology (1153)
  • Occupational and Environmental Health (961)
  • Oncology (3370)
  • Ophthalmology (989)
  • Orthopedics (370)
  • Otolaryngology (421)
  • Pain Medicine (437)
  • Palliative Medicine (131)
  • Pathology (670)
  • Pediatrics (1704)
  • Pharmacology and Therapeutics (700)
  • Primary Care Research (717)
  • Psychiatry and Clinical Psychology (5497)
  • Public and Global Health (9288)
  • Radiology and Imaging (2225)
  • Rehabilitation Medicine and Physical Therapy (1375)
  • Respiratory Medicine (1202)
  • Rheumatology (598)
  • Sexual and Reproductive Health (721)
  • Sports Medicine (536)
  • Surgery (722)
  • Toxicology (100)
  • Transplantation (290)
  • Urology (267)