TY - JOUR T1 - Artificial intelligence-driven real-time 3D surface quantification of Barrett’s oesophagus for risk stratification and therapeutic response monitoring JF - medRxiv DO - 10.1101/2020.10.04.20206482 SP - 2020.10.04.20206482 AU - Sharib Ali AU - Adam Bailey AU - James E. East AU - Simon J. Leedham AU - Maryam Haghighat AU - TGU Investigators AU - Xin Lu AU - Jens Rittscher AU - Barbara Braden Y1 - 2020/01/01 UR - http://medrxiv.org/content/early/2020/10/06/2020.10.04.20206482.abstract N2 - BACKGROUND & AIMS Barrett’s epithelium measurement using widely accepted Prague C&M criteria is highly operator dependent. By reconstructing the surface of the Barrett’s area in 3D from endoscopy video, we propose a novel methodology for measuring the C&M score automatically. This 3D reconstruction provides an extended field of view and also allows to precisely quantify the Barrett’s area including islands. We aim to assess the accuracy of the extracted measurements from phantom and demonstrate their clinical usability.METHODS Advanced deep learning techniques are utilised to design estimators for depth and camera pose required to map standard endoscopy video to a 3D surface model. By segmenting the Barrett’s area and locating the position of the gastro-oesophageal junction (GEJ) we measure C&M scores and the Barrett’s oesophagus areas (BOA). Experiments using a purpose-built 3D printed oesophagus phantom and high-definition video from 98 patients scored by an expert endoscopist are used for validation.RESULTS Endoscopic phantom video data demonstrated a 95 % accuracy with a marginal ± 1.8 mm average deviation for C&M and island measurements, while for BOA we achieved nearly 93 % accuracy with only ± 1.1 cm2 average deviation compared to the ground-truth measurements. On patient data, the C&M measurements provided by our system concord with the reference provided by expert upper GI endoscopists.CONCLUSIONS The proposed methodology is suitable for extracting Prague C&M scores automatically with a high degree of accuracy. Providing an accurate measurement of the entire Barrett’s area provides new opportunities for risk stratification and the assessment of therapy response.Competing Interest StatementJ. E. East has served on clinical advisory board for Lumendi, Boston Scientific and Paion; Clinical advisory board and ownership, Satisfai Health; Speaker fees, Falk. J. Rittscher is the co-founder of University of Oxford spinout Ground Truth Labs. Patent is pending for this work.Funding StatementThe research was supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). The views expressed are those of the author(s) and not necessarily those of the National Health Service, the NIHR or the Department of Health. S. Ali, A. Bailey, J. E. East, and B. Braden are supported by NIHR BRC, X. Lu by Ludwig Institute for Cancer Research (LICR) and J. Rittscher by LICR and EPSRC Seebibyte Programme Grant (EP/M0133774/1). M. Haghighat is funded by Innovate UK, PathLAKE project and S. J. Leedham is supported by Wellcome Trust Senior Clinical Research Fellowship (206314/Z/17/Z) and NIHR BRC.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The study was approved by the local Research Ethics Committee (REC Ref: 16/YH/0247)All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe authors confirm that the data supporting the findings of this study are available within the article and its supplementary materials. ER -