Structured Abstract
Objective To evaluate accuracy and reproducibility of 2D echocardiography (2DE) left ventricular (LV) volumes and ejection fraction (LVEF) estimates by Deep Learning (DL) vs. manual contouring and against CMR.
Background 2DE LV manual segmentation for LV volumes and LVEF calculation is time consuming and operator dependent.
Methods A DL-based convolutional network (DL1) was trained on 2DE data from centre A, then evaluated on 171 subjects with a wide range of cardiac conditions (49 healthy) – 31 subjects from centre A (18%) and 140 subjects from centre B (82%) – who underwent 2DE and CMR on the same day. Two senior (A1 and B1) and one junior (A2) cardiologists manually contoured 2DE end-diastolic (ED) and end-systolic (ES) endocardial borders in the cycle and frames of their choice. Selected frames were automatically segmented by DL1 and two DL algorithms from the literature (DL2 and DL3), applied without adaptation to verify their generalizability to unseen data. Interobserver variability of DL was compared to manual contouring. All ESV, EDV and EF values were compared to CMR as reference.
Results 50% of 2DE images were of good quality. Interobserver agreement was better by DL1 and DL2 than by manual contouring for EF (Lin’s concordance = 0.9 and 0.91 vs. 0.84), EDV (0.98 and 0.99 vs. 0.82), and ESV (0.99 and 0.99 vs. 0.89). LVEF bias was similar or reduced using DL1 (-0.1) vs. manual contouring (3.0), and worse for DL2 and DL3. Agreement between 2DE and CMR LVEF was similar or higher for DL1 vs. manual contouring (Cohen’s kappa = 0.65 vs. 0.61) and degraded for DL2 and DL3 (0.48 and 0.29).
Conclusion DL contouring yielded accurate EF measurements and generalized well to unseen data, while reducing interobserver variability. This suggests that DL contouring may improve accuracy and reproducibility of 2DE LVEF in routine practice.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
The authors received no specific funding for this work. Alexandre Popoff (AP), Mathieu De Craene (MDC), Guillaume Pizaine GP) and Pascal Allain (PA) are employed by Philips Medical Systems. Hélène Langet (HL), Romane Gauriau (RG) and Paulo Piro (PP) were employed by Philips Medical Systems at the time of the study. Centre Hospitalier Universitaire Caen Normandie and Cliniques Universitaires Saint-Luc have a master research agreement with Philips France Commercial.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The studies were approved by the IRB in charge (either Comité Ethique Hospital- Facultaire de l’Université Catholique de Louvain, Brussels, Belgium or Comité de Protection des Personnes Nord-Ouest III, Caen, France). The retrospective use of these data satisfies the European Union (EU) General Data Protection Regulation (GDPR) requirements.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Relation with Industry Disclosure: AP, MDC, GP and PA are employed by Philips Medical Systems. HL, RG and PP were employed by Philips Medical Systems at the time of the study. Centre Hospitalier Universitaire Caen Normandie and Cliniques Universitaires Saint-Luc have a master research agreement with Philips Medical Systems.
Data Availability
All DICOM files of AP2, AP4 images will be made available upon acceptance on a public web page. An excel file containing all quantification from MR will also be made available.
List of Abbreviations and Acronyms
- AP4
- apical 2-chamber
- AP2
- apical 4-chamber
- CCC
- Lin’s concordance correlation coefficient
- CMP
- cardiomyopathy
- DL
- deep learning
- EF
- ejection fraction
- ED[V]
- end-diastolic [volume]
- ES[V]
- end-systolic [volume]
- LV
- left ventricle
- VOL
- healthy volunteer
