Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Automated interpretation of the coronary angioscopy with deep convolutional neural networks

Toru Miyoshi, View ORCID ProfileAkinori Higaki, Hideo Kawakami, Osamu Yamaguchi
doi: https://doi.org/10.1101/19001693
Toru Miyoshi
1Department of Cardiology, Ehime Prefectural Imabari Hospital, Imabari, Japan
4Department of Cardiovascular Medicine, Osaka University Graduate School of Medicine, Suita, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Akinori Higaki
2Department of Cardiology, Pulmonology, Hypertension and Nephrology, Ehime University Graduate School of Medicine, Toon, Japan
3Hypertension and Vascular Research Unit, Lady Davis Institute for Medical Research, Sir Mortimer B. Davis Jewish General Hospital, McGill University, Montreal, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Akinori Higaki
  • For correspondence: akinori.higaki@mail.mcgill.ca
Hideo Kawakami
1Department of Cardiology, Ehime Prefectural Imabari Hospital, Imabari, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Osamu Yamaguchi
2Department of Cardiology, Pulmonology, Hypertension and Nephrology, Ehime University Graduate School of Medicine, Toon, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Coronary angioscopy (CAS) is a useful modality to assess atherosclerotic changes, but interpretation of the images requires expert knowledge. Deep convolutional neural networks (DCNN) can be used for diagnostic prediction and image synthesis.

Methods 107 images from 47 patients, who underwent coronary angioscopy in our hospital between 2014 and 2017, and 864 images, selected from 142 MEDLINE-indexed articles published between 2000 and 2019, were analyzed. First, we developed a prediction model for the angioscopic findings. Next, we made a generative adversarial networks (GAN) model to simulate the CAS images. Finally, we tried to control the output images according to the angioscopic findings with conditional GAN architecture.

Results For both yellow color (YC) grade and neointimal coverage (NC) grade, we could observe strong correlations between the true grades and the predicted values (YC grade, average r value = 0.80 ± 0.02, p-value <0.001; NC grade, average r value = 0.73 ± 0.02, p < 0.001). The binary classification model for the red thrombus yielded 0.71 ± 0.03 F1-score and the area under the ROC curve (AUC) was 0.91 ± 0.02. The standard GAN model could generate realistic CAS images (average Inception score = 3.57 ± 0.06). GAN-based data augmentation improved the performance of the prediction models. In the conditional GAN model, there were significant correlations between given values and the expert’s diagnosis in YC grade and NC grade.

Conclusion DCNN is useful in both predictive and generative modeling that can help develop the diagnostic support system for CAS.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

No funding source concerning this study.

Author Declarations

All relevant ethical guidelines have been followed and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

Any clinical trials involved have been registered with an ICMJE-approved registry such as ClinicalTrials.gov and the trial ID is included in the manuscript.

Not Applicable

I have followed all appropriate research reporting guidelines and uploaded the relevant Equator, ICMJE or other checklist(s) as supplementary files, if applicable.

Not Applicable

Data Availability

The publication list where we collected angioscopic images and the source code of the prediction and generative models are available from the public online repository. The de-identified angioscopic images we used in this study are available directly from the corresponding author upon reasonable request.

http://dx.doi.org/10.17632/9dx23j5d64.1

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted January 08, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Automated interpretation of the coronary angioscopy with deep convolutional neural networks
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Automated interpretation of the coronary angioscopy with deep convolutional neural networks
Toru Miyoshi, Akinori Higaki, Hideo Kawakami, Osamu Yamaguchi
medRxiv 19001693; doi: https://doi.org/10.1101/19001693
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Automated interpretation of the coronary angioscopy with deep convolutional neural networks
Toru Miyoshi, Akinori Higaki, Hideo Kawakami, Osamu Yamaguchi
medRxiv 19001693; doi: https://doi.org/10.1101/19001693

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Cardiovascular Medicine
Subject Areas
All Articles
  • Addiction Medicine (160)
  • Allergy and Immunology (413)
  • Anesthesia (90)
  • Cardiovascular Medicine (855)
  • Dentistry and Oral Medicine (159)
  • Dermatology (97)
  • Emergency Medicine (248)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (393)
  • Epidemiology (8550)
  • Forensic Medicine (4)
  • Gastroenterology (383)
  • Genetic and Genomic Medicine (1744)
  • Geriatric Medicine (167)
  • Health Economics (371)
  • Health Informatics (1237)
  • Health Policy (619)
  • Health Systems and Quality Improvement (467)
  • Hematology (196)
  • HIV/AIDS (372)
  • Infectious Diseases (except HIV/AIDS) (10281)
  • Intensive Care and Critical Care Medicine (552)
  • Medical Education (192)
  • Medical Ethics (51)
  • Nephrology (210)
  • Neurology (1670)
  • Nursing (97)
  • Nutrition (248)
  • Obstetrics and Gynecology (325)
  • Occupational and Environmental Health (450)
  • Oncology (926)
  • Ophthalmology (263)
  • Orthopedics (100)
  • Otolaryngology (172)
  • Pain Medicine (112)
  • Palliative Medicine (40)
  • Pathology (252)
  • Pediatrics (534)
  • Pharmacology and Therapeutics (247)
  • Primary Care Research (207)
  • Psychiatry and Clinical Psychology (1764)
  • Public and Global Health (3832)
  • Radiology and Imaging (622)
  • Rehabilitation Medicine and Physical Therapy (319)
  • Respiratory Medicine (520)
  • Rheumatology (207)
  • Sexual and Reproductive Health (165)
  • Sports Medicine (157)
  • Surgery (190)
  • Toxicology (36)
  • Transplantation (101)
  • Urology (74)