A Hybrid Catheter Localisation Framework in Echocardiography Based on Electromagnetic Tracking and Deep Learning Segmentation
=============================================================================================================================

* Fei. Jia
* Shu. Wang

## Abstract

Interventional cardiology procedure is an important type of minimally invasive surgery that deals with the catheter-based treatment of cardiovascular diseases, such as coronary artery diseases, strokes, peripheral arterial diseases and aortic diseases. Ultrasound imaging, also called echocardiography, is a typical imaging tool that monitors catheter puncturing. Localising a medical device accurately during cardiac interventions can help improve the procedure’s safety and reliability under ultrasound imaging. However, external device tracking and image-based tracking methods can only provide a partial solution. Thus, we proposed a hybrid framework, with the combination of both methods to localise the catheter tip target in an automatic way. The external device used was an electromagnetic tracking system from North Digital Inc (NDI) and the ultrasound image analysis was based on UNet, a deep learning network for semantic segmentation. From the external method, the tip’s location was determined precisely, and the deep learning platform segmented the exact catheter tip automatically. This novel hybrid localisation framework combines the advantages of external electromagnetic (EM) tracking and deep-learning-based image method, which offers a new solution to identify the moving medical device in low-resolution ultrasound images.

**Featured Application** This framework can be applied to other medical-device localisation fields to help doctors identify a moving target in low-resolution ultrasound images.

Keywords
*   cardiac intervention
*   echocardiography
*   electromagnetic (EM) tracking
*   deep learning
*   catheter localisation

## 1. Introduction

A cardiac interventional procedure, also known as an interventional cardiology procedure, is an important type of minimally invasive surgery that deals with catheter-based treatment of cardiovascular diseases, such as coronary artery diseases, strokes, peripheral arterial diseases and aortic diseases [1]. Generally, it can be classified into the following categories: cardiac catheterization, percutaneous coronary intervention, stents, embolic protection, percutaneous valve repair, balloon valvuloplasty and atherectomy. Catheter is the medical device used in most cardiac interventions that can be inserted into the body, which functionally allows for drainage, administration of fluids or gases, ablation and other tasks [2]. There are various types of catheters aiming at different medical applications, for example, the ablation catheter is specifically used for tissue ablation with the generated heat on the electrodes, the pacemaker catheter is to help heart pump, a central venous catheter is a conduit to give drugs positioned either in a vein near the heart or inside the atrium. As an example of the procedure, a right-heart catheterization to treat atrial fibrillation requires the catheter to be inserted through the femoral vein and the superior vena cava to the right ventricle. The catheter is placed at the exact site inside the chamber, where the tips emit electrical signals that stimulate abnormal heart rhythm, followed by the transmission of a mild and painless radiofrequency energy to the pathway that destroys the targeted lesion area.

Image guidance during cardiac intervention is a key concept to guarantee patient safety while the direct line of sight is inhibited. X-ray imaging, traditionally, dominates the guidance during cardiovascular interventional procedures, but it provides limited views when the interventions involve the myocardium, pericardium and cardiac valves. Therefore, cardiac ultrasound (echocardiography) was introduced to navigate these challenges. Compared to cardiac X-ray imaging, echocardiography is especially useful for transcatheter puncture, percutaneous mitral valve procedures and left atrial appendage closure. Echocardiography fulfils the requirements by providing a real-time imaging solution, with both device and cardiac inner structure demonstration simultaneously [3]. There are three types of echocardiography that can be used during intervention: Transthoracic echocardiography (TTE), intracardiac echocardiography (ICE) and transoesophageal echocardiography (TEE/TOE). TTE is widely available and portable. It is a non-invasive imaging procedure [4]. However, it possesses limited ability to visualise the back of the heart and is difficult to use during interventional procedures. ICE has also demonstrated great potential for in-vivo medical device monitoring, where a thin probe is inserted inside a patient, but this phased array probe is expensive and can only be used once. Additionally, ICE offers no standard views [5]. As a trade-off between the image quality and imaging cost obtained through an echocardiography, TOE imaging is commonly chosen during the catheter-based intervention. Prior to imaging, the patient lies in the left lateral decubitus position, and swallows the probe following the instruction during probe insertion. Mild to moderate sedation is induced in the patient to ease discomfort and to decrease the gag reflex by providing medications, such as midazolam. This makes the ultrasound probe pass easily into the oesophagus.

Currently, 2-D multiplane imaging is the most widely used mode of TOE, providing 20 standard trans-oesophageal echocardiographic views that can facilitate and provide consistency in training, reporting, archiving and quality assurance (as published by the American Society of Echocardiography (ASE) and the Society of Cardiovascular Anaesthesiologists (SCA)) [6]. In clinical practice, before localising and tracking the device from echocardiography, a specific standard view should be determined first. For instance, to view the general four chambers, the probe is positioned at the mid-oesophagus with a zero degree rotation. It is then placed at the same position with a 40 degrees rotation. The aortic valve short-axis view can be obtained when the probe goes deeper into the stomach. The right ventricle and left ventricle views can be obtained at the same time from the transgastric apical short-axis view.

To ensure that the catheter tip is accurately localised during a safe interventional procedure when obtaining TOE imaging views, a reliable tracking solution is required. Currently, solutions, in general, can be categorized into two classes: the external tracking system and image-based method. The external tracking system needs to utilise an extra device to determine the catheter tip location; for example, the Bard Access product that employs the tip confirmation system (TCS) displays different electrocardiogram (ECG) signals, corresponding to different catheter locations [7]. However, surgeons require additional time and knowledge to analyse the external device and, occasionally, these external devices are largely affected by clinical environments. In comparison with external tracking methods, an image-based method is more distinct and easier to apply. Consequently, in recent years, the image-based method has attracted a lot of research attention. Previously, many image-based catheter tracking algorithms were performed on X-ray datasets instead of echocardiography datasets because X-ray images, electrodes or catheter tips possess distinct characteristic features that can be used for tracking and detection. At the same time, these features were vague in an ultrasound, which led to difficulties in localisation using only the image-based method. The classic image-based methods could only be applied on a small number of images. The methods utilised hand-crafted features. On the contrary, with deep learning, image tasks of greater difficultly can be achieved by end-to-end convolutional neural networks (CNN) [8]. Recently, the use of deep learning has been increasing rapidly in the medical imaging field, including computer-aided diagnosis (CAD), radiomics and medical image analysis [9].

However, the previous external tracking and image-based methods were two distinct localisation solutions to determine the catheter tip and no combination of these two methods was proposed with previous research studies. Driven by the motivation of assisting cardiologists and sonographers to track the catheter tip during intervention in a radiation-free and accurate way, this paper proposes a hybrid localisation framework on echocardiography images, with a combination of both EM tracking and deep-learning-based image analysis. The echocardiography images are collected on a 3D-printed tissue-mimicking cardiac phantom using a porous material--Lay-Fomm 40 [10] --obtained from several standard TOE views with the Philips IE33 ultrasound machine [11]. Prior to ultrasound imaging, the catheter tip is first localised by the NDI EM tracking systems [12] using a pivot calibration [13] with an error less than 0.1 mm. Following data collection, all echocardiography images are processed with the Python 3 platform, using the UNet [14] automatic segmentation kernel. This hybrid localisation network can provide a reliable reference for new sonographers and doctors during catherization.

## 2. Materials and Methods

### 2.1. Echocardiography Image Collection for Catheter Localisation Model Training

Due to limitations in the availability of the open-source echocardiography dataset and a lack of information to accurately locate the catheter tip, a complete echocardiography image dataset needs to be developed first. To obtain the catheter tip information, at the same time, instead of using real patient data, the cardiac interventional procedure was simulated on a 3-D printed Lay-Fomm 40 phantom, which can fully resemble an adult patient heart. During imaging, the Philips S5-1 broadband sector array probe was placed on top of the cardiac phantom, while the phantom was fixed at the bottom of a plastic water tank. Subsequently, several TOE standard views were acquired by probe manipulation, such as the upper aortic valve view (commonly chosen in a real patient case). During the simulation, the Philips IE33 ultrasound machine was set to full volume mode with each image acquisition lasting for five seconds. All the DICOM images were then exported to blank CDs and analysed with ITK-SNAP [15].

The corresponding ultrasound imaging results of the Shelley medical ablation catheter movements can be observed in Figure 1 (b), in which the vertical line (circled area) indicates the catheter shape. While the horizontal line is the artefact, which will not be labelled in the following works. The cardiac phantom is fabricated based on the segmentation from a chest male patient CT scan, with full four chambers as well as valve and vascular structures, while the printed material is proven to be ultrasound compatible from the experiment in figure 2 (b). In Figure 2, we can also observe from the echo image that the background contained both the ablation catheter and the cardiac structures. In the aortic valve, the visualisation of the catheter is not only affected by the valve structure but also affected by strong reverberations from the water tank. The low-image resolution also increases the difficulty to localise the catheter tip accurately.

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F1)

Figure 1. 
(a) Shelley Medical Ablation Catheter. (b) Corresponding 2-D Ultrasound Image of (a).

![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F2.medium.gif)

[Figure 2.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F2)

Figure 2. 
Catheter Tip Movement. (a) 2-D Echocardiography Image Acquisition on 3-D Printed Cardiac Phantom. (b) Corresponding Ultrasound Results of (a) Under Aortic Valve Short-Axis View

### 2.2. Catheter Tip Determination via External EM Device & Pivot Calibration

Before applying the deep learning network in image-based methods for automatic catheter segmentation, it was necessary to determine the exact location of the tracked catheter tip in the trained ultrasound dataset to provide the groundtruth. As illustrated in Figures 1 and 2, it is usually difficult to identify the catheter tip in the image by visual inspection alone. Therefore, mapping the physical location of the catheter tip to where it appears in the ultrasound imaging provided an alternative approach to obtain a reliable groundtruth.

In this section, the NDI Aurora EM tracking system [12] depicted in Figure 3 (a) was used to arrive at the catheter tip’s location physically because of its non-radiation and real-time 3-D tracking ability. This system consists of an EM field generator and a sensor interface unit to connect the sensor and the system control unit (SCU) connected to the computer. To simplify the setup, a 6-degree of freedom (DOF) catheter-type EM sensor from NDI was used to represent the catheter, as it could generate a mapped point on a 2-D ultrasound image as indicated in Figure 3 (b). The Shelley medical ablation catheter could not be directly connected to the EM tracking device. It was tied to the sensor, so that the tracked tip location could be shared. The physical location of the tip was calculated through a pivot calibration experiment. The use of external EM tracking is to determine the length of catheter tip before training the lateral network, without EM tracking, the catheter tip cannot be defined during groundtruth labelling.

![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F3.medium.gif)

[Figure 3.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F3)

Figure 3. 
(a) Illustration of Pivot Calibration Using NDI Aurora EM Tracking System. (b) Mapped Location of Catheter Tip in 2D Echocardiography.

During tracking, all the data was recorded by the EM tracking device, saved as a text file and then processed further in MATLAB. Initially, the EM tracking device recorded the sensor’s 3-D location with the help of the tracking system coordinates. Through pivot calibration, the sensor was manually moved around a fixed pivot point near the EM field generator. The corresponding location matrix in the tracking system coordinates were transformed through formulae (1)–(5). ![Formula][1]</img>  ![Formula][2]</img>  ![Formula][3]</img>  ![Formula][4]</img>  ![Formula][5]</img>  

### 2.3. Automatic Catheter Segmentation in 2-D Echocardiography through Deep Learning

After determining the location of the ablation catheter tip physically, the state-of-the-art UNet was utilized to train the deep-learning-based automatic segmentation platform on the collected phantom echocardiography from different standard TOE views [16]. To make the trained model more robust, another 19 real patient TOE folders were mixed and tested at the same time.

Most of the image-based localisations mentioned in literatures were performed either through tracking with an inaccurate bounding box or by locating landmarks from registration. Both of these methods lacked the target shape information. However, semantic segmentation could solve the difficulty associated with accurate localisation. Currently, the state-of-the-art semantic segmentation model being employed is UNet, which is depicted in Figure 4 [14]. This model can be used on smaller datasets, such as medical images for faster training, while the deep learning models have to be trained on larger datasets with more variations. Unlike a model based on CNN, which can only predict probability distribution, UNet is built with a fully convolutional network (FCN) [17] kernel. It can, thus, directly provide a full and accurate output segmentation map on the image.

![Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F4.medium.gif)

[Figure 4.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F4)

Figure 4. 
Diagram of Deep Learning Model Trained on 2-D Echocardiography Dataset.

The segmentation model was built on 2-D TOE images, collected from the Lay-Fomm 40 cardiac phantom, fabricated prior to obtaining both standard and non-standard views, with the ablation catheter moving from random places in the image. The image dataset contained 20 image volumes with 75 slices for each volume. The example provided in Figure 4 is a bicaval view with the catheter segmentation in the right atrium, and all of the groundtruth labels were obtained from the doctors’ manual segmentation (under the reference of both EM tracking results and visual inspections). The segmentation algorithm is written in Python 3. As illustrated from Figure 5, the model training procedure consisted of the following main steps:

![Figure 5.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F5.medium.gif)

[Figure 5.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F5)

Figure 5. 
Flow chart of Echocardiography UNet Model Training Procedure.

1.  DICOM image reading and data cleaning

2.  Data augmentation to enlarge the training dataset

3.  Obtain a random positive and negative patch

4.  Train and validate the patch based on 2-D UNet

5.  Generate the Dice loss plot for parameter tuning

6.  Test and generate the predicted segmentation

The parameters used in the UNet segmentation model were:

1.  First ten volumes as the training dataset, second set of ten volumes as the validation dataset and testing on 14 random 2-D echocardiography volumes

2.  Dropout at the last layer with the rate of 0.5

3.  Augmenting the data offline to ten times as before

4.  Use early stopping with patience of 6000 iterations

5.  Positive and negative rate of 0.95 (when the image slice contained the segmentation target, we regarded it as a positive slice)

6.  Patch size of 1,448,448

7.  Batch size of four

8.  Total number of iterations (batch size) were 30000

9.  Iterative UNet depth of five

10. Loss function: Dice loss and Laplace smoothing for preventing overfitting

11. Activation function as ReLU

To better describe the performance by automatic segmentation when compared to groundtruth labelling, we introduced a Dice loss to evaluate how accurate the prediction would be (calculated through equation [37]) ![Formula][6]</img>  In the above equation, X is the predicted segmentation, Y is the true segmentation, TP stands for true positive and FP and FN are false positive and false negative rates respectively. The Dice accuracy results on the testing dataset will be demonstrated in the Results and Discussion section.

## 3. Results and Discussion

The physical localisation result of the targeted ablation catheter was 4.7362 ± 0.3523 mm, and the corresponding catheter’s groundtruth segmentation is indicated in Figure 6 (a). Figure 6 (b) indicates the corresponding prediction results of Figure 6 (a), trained by the deep learning platform. The original 2-D echocardiography of Figure 6 is the simulated result collected on the 3-D printed cardiac phantom. With the proposed hybrid framework, the accuracy of the catheter tip’s groundtruth location can be guaranteed to 0.1mm. When compared to the traditional groundtruth by considering a doctor’s visual inspection alone, this new groundtruth is more reliable. During the catheter movement, the final trained model could still identify the dynamic target as indicated in Figure 7. Within one second, no catheter tip was missing in every single frame, but at the same time, as the current deep learning network has limited ability in recognizing moving target, in figure 7, some predicted segmentations are incomplete compared to the groundtruth. The corresponding Dice accuracy results are as follows:

![Figure 6.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F6.medium.gif)

[Figure 6.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F6)

Figure 6. 
(a) Groundtruth segmentation of Shelley medical ablation catheter. (b) Deep learning platform predicted catheter segmentation on simulated 2-D echocardiography.

![Figure 7.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F7.medium.gif)

[Figure 7.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F7)

Figure 7. 
Catheter Tip Segmentation Results by Deep Learning Platform in 2-D Echocardiography Sequences (a) 0.1s (b) 0.2s (c) 0.3s (d) 0.4s (e) 0.5s (f) 0.6s (g) 0.7s (h) 0.8s (i) 1s

![Formula][7]</img> 
The training and testing of the Dice loss plots, indicated in Figure 8, are consistent with the aforementioned accuracy results. The Dice loss on training dataset was rather low. However, on the validation dataset, the Dice loss rose significantly (which indicated that the trained model was overfitting to a certain extent). Upon comparing the UNet model accuracy on other high-image quality datasets, the lower prediction accuracy could be explained with the target being too sparse and ambiguous to identify. Therefore, the accuracy obtained cannot compete with the performance on CT or MRI volumes. Except for the difficulty faced (due to the target being sparse or ambiguous), another challenge attributed to the limited variation of TOE images obtained, caused the overfitting of the model, which was unavoidable.

![Figure 8.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F8.medium.gif)

[Figure 8.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F8)

Figure 8. 
Training curve of the deep learning model’s training and validation loss.

To validate the trained model’s ability for generalisation, the model was also tested with real patient data obtained from several standard TOE views, such as the mid-oesophagus right ventricle (ME-RV) inflow view and the transgastric basal short-axis (TG basal SAX) view. From Figure 9, the predicted results proved the generalisation ability of the proposed model with correct catheter location and shape. As the target was too blurred, the shape may have varied from the groundtruth to a certain level.

![Figure 9.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/12/24/2020.12.22.20248705/F9.medium.gif)

[Figure 9.](http://medrxiv.org/content/early/2020/12/24/2020.12.22.20248705/F9)

Figure 9. 
Validation of the model on real patient echocardiography (a)–(c): groundtruth segmentation from ME-RV inflow, TG Basal SAX and bicaval view. (d)–(f): deep learning predicted segmentation of (a)–(c)

## 4. Conclusions and Future plans

EM tracking device is easily get affected by the clinical environment, and it cannot provide the visual information of the medical device; while the target in medical images cannot provide the numerical results. This new hybrid localisation framework combines the advantages of external EM tracking and deep-learning-based image methods, and successfully builds up the connection between the physical coordinate and the image coordinates, which offers a new solution for obtaining a more reliable groundtruth to train the automatic deep learning model. At the same time, 3-D printed phantoms also provide a new direction for collecting the original dataset to train the deep learning models based on our requirements.

Based on the simulated dataset and EM tracking tip determinations, the reliability of deep-learning-based models can be guaranteed. However, the model’s accuracy and stability need to be improved in the future. During the future improvement, the groundtruth labels have to be derived from the EM sensor, while all the possible standard views need to be classified too. Due to the dataset limitations, all the networks built thus far faced the overfitting problem, so an adequate fully automatic solution for cardiac intervention has not yet been achieved.

The future plan will be to try and optimise this platform from the following perspectives: TOE standard view classification and learning and EM tracking groundtruth labelling. To improve manual inspection, automatic EM tracking mapping system will be developed, so that the automatic labelling of the groundtruth can replace the current semi-automatic method. Increased real patient data will be involved and analysed (including the condition of the patients) with a variety of different machines, including catheters. Meanwhile, the deep learning model will also be optimised into a more stable and accurate one, which can adapt to accommodate a larger patient dataset.

## Data Availability

The data in this statement can be accessed via the following links: https://www.dropbox.com/s/75vc47oahi1tmkx/MDPI-images.zip?dl=0

## Author Contributions

Ultrasound data collection and EM tracking experiments – Shu. Wang. UNet segmentation and analysis – Fei. Jia. Writing and original draft preparation – Shu. Wang and Fei. Jia. Writing, reviewing and editing – Fei. Jia. Funding – Shu. Wang and Fei. Jia. Supervision – Shu Wang.

## Funding

This research received funding from the Chinese Scholarship Council and the Beijing Chuangxinhuizhi Co Ltd.

## Conflicts of Interest

The authors declare no conflict of interest.

## Acknowledgments

We would like to express our gratitude for the financial support provided by the Chinese Scholarship Council and the Beijing Chuangxinhuizhi Co Ltd. We would also like to express our gratitude for the precious help provided by King’s College London.

## Footnotes

*   1 fei.jia{at}kcl.ac.uk

*   2 shu.1.wang{at}kcl.ac.uk

*   Received December 22, 2020.
*   Revision received December 22, 2020.
*   Accepted December 23, 2020.


*   © 2020, Posted by Cold Spring Harbor Laboratory

The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission.

## References

1.  1. Xianliang Wu. Fast Catheter segmentation and tracking based on X-ray fluoroscopic and echocardiographic modalities for catheter-based cardiac minimally invasive interventions. PhD Thesis. Imperial College London, London, 2014.
    
    

2.  2.Diggery, Robert. Catheters: Types, applications and potential complications medical devices and equipment. Nova Science. New York, USA, 2012. ISBN 978-1621006305. pp: 1.
    
    

3.  3. Nina Wunderlich, et al. 3D Echo Guidance for Structural Heart Interventions. Interventional Cardiology 2009;4(1). pp:16–20. doi: 10.15420/icr.2009.4.1.16
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.15420/icr.2009.4.1.16&link_type=DOI) 

4.  4.Frank E. Silvestry. et al. ASE Recommendations for Clinical Practice: Echocardiography-Guided Interventions. Journal of the American Society of Echocardiography 2009, Volume 22, Number 3. pp: 213–231. doi: 10.1016/j.echo.2008.12.013
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.echo.2008.12.013&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19258174&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F24%2F2020.12.22.20248705.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000263792000001&link_type=ISI) 

5.  5.Jongbloed MRM, Schalij MJ, Zeppenfeld K, et al. Clinical applications of intracardiac echocardiography in interventional procedures. Heart (British Cardiac Society) 2005; 91(7):981–90. doi: 10.1136/hrt.2004.050443
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiaGVhcnRqbmwiO3M6NToicmVzaWQiO3M6ODoiOTEvNy85ODEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8xMi8yNC8yMDIwLjEyLjIyLjIwMjQ4NzA1LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

6.  6.Shanewise JS, Cheung AT, Aronson S, et al. ASE/SCA guidelines for performing a comprehensive intraoperative multiplane transesophageal echocardiography examination. Anesthesia & Analgesia, 1999, 89(4): p. 870–84. doi: 10.1097/00000539-199910000-00010
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/00000539-199910000-00010&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=10512257&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F24%2F2020.12.22.20248705.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000082827700010&link_type=ISI) 

7.  7. A. J. Johnston; et al. Evaluation of the Sherlock 3CG Tip Confirmation System on peripherally inserted central catheter malposition rates. Anaesthesia 2014, 69, 1322–1330. doi:10.1111/anae.12785
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/anae.12785&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25040430&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F24%2F2020.12.22.20248705.atom) 

8.  8. B. Zhou,  A. Khosla,  A. Lapedriza,  A. Oliva and  A. Torralba, “Learning Deep Features for Discriminative Localization,” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016, pp. 2921–2929, doi: 10.1109/CVPR.2016.319.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/CVPR.2016.319&link_type=DOI) 

9.  9. Kenji Suzuki. Overview of deep learning in medical imaging. Radiol Phys Technol 2017. 10(3):257–273. doi: 10.1007/s12194-017-0406-5.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s12194-017-0406-5&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28689314&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F24%2F2020.12.22.20248705.atom) 

10. 10.POROLAY-Serie - LAYFOMM 40/60 - GELLAY - LAYFELT. [https://www.3d-printshop.biz/POROLAY](https://www.3d-printshop.biz/POROLAY). (accessed on 1 Dec 2020)
    
    

11. 11.Philips iE33 Ultrasound System - Avante Health Solutions. Available online: [https://avantehs.com/p/philips-ie33-ultrasound-system/12681](https://avantehs.com/p/philips-ie33-ultrasound-system/12681) (accessed on 02 11 2020)
    
    

12. 12. Christopher Nafis; et al. Method for estimating dynamic EM tracking accuracy of surgical navigation tools. Proc. SPIE 6141, Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, 61410K (10 March 2006); doi: 10.1117/12.653448.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1117/12.653448&link_type=DOI) 

13. 13. Ziv Yaniv. Which Pivot Calibration? Proceedings of SPIE Vol. 941527, (2015). doi: 10.1117/12.2081348
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1117/12.2081348&link_type=DOI) 

14. 14.Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation.Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Lecture Notes in Computer Science, vol 9351. Springer, Cham. doi: 10.1007/978-3-319-24574-4_28
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/978-3-319-24574-4_28&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=WOS:00036596&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F24%2F2020.12.22.20248705.atom) 

15. 15. Paul A. Yushkevich,  Joseph Piven,  Heather Cody Hazlett,  Rachel Gimpel Smith,  Sean Ho,  James C. Gee, and  Guido Gerig. User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability. Neuroimage 2006 Jul 1; 31(3): 1116–28. doi: 10.1016/j.neuroimage.2006.01.015.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.neuroimage.2006.01.015&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16545965&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F12%2F24%2F2020.12.22.20248705.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000238358500015&link_type=ISI) 

16. 16.Virtual TEE: Standard Views, Cardiac, Transesophageal Echocardiography, 3D Heart Model, Education. Available online: [http://pie.med.utoronto.ca/TEE/TEE\_content/TEE\_standardViews\_intro.html](http://pie.med.utoronto.ca/TEE/TEE_content/TEE_standardViews_intro.html) (accessed on 04 11 2020)
    
    

17. 17.Shelhamer, E., Long, J., & Darrell, T. Fully Convolutional Networks for Semantic Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017, vol. 39, pp 640–651. doi: 10.1109/TPAMI.2016. 2572683
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/TPAMI.2016&link_type=DOI)

 [1]: /embed/graphic-4.gif
 [2]: /embed/graphic-5.gif
 [3]: /embed/graphic-6.gif
 [4]: /embed/graphic-7.gif
 [5]: /embed/graphic-8.gif
 [6]: /embed/graphic-11.gif
 [7]: /embed/graphic-14.gif