PT  - JOURNAL ARTICLE
AU  - Eduardo B. Mariottoni
AU  - Alessandro A. Jammal
AU  - Samuel I. Berchuck
AU  - Ivan M. Tavares
AU  - Felipe A. Medeiros
TI  - An Objective Structural and Functional Reference Standard for Diagnostic Studies in Glaucoma
AID  - 10.1101/2020.04.10.20057836
DP  - 2020 Jan 01
TA  - medRxiv
PG  - 2020.04.10.20057836
4099  - http://medrxiv.org/content/early/2020/04/19/2020.04.10.20057836.short
4100  - http://medrxiv.org/content/early/2020/04/19/2020.04.10.20057836.full
AB  - Purpose To propose a reference standard for the definition of glaucomatous optic neuropathy (GON) consisting of objective parameters from spectral-domain optical coherence tomography (SDOCT) and standard automated perimetry (SAP), and to apply it to the development and evaluation of a deep learning (DL) algorithm to detect glaucomatous damage on fundus photographs.Design Retrospective, cross-sectional study.Methods Data were extracted from the Duke Glaucoma Registry and included 2,927 eyes of 2,025 participants with fundus photos, SDOCT and SAP acquired within six months. Eyes were classified as GON versus normal based on a combination of objective SDOCT and SAP criteria. A DL convolutional neural network was trained to predict the probability of GON from fundus photos. The algorithm was tested on an independent sample with performance assessed by sensitivity, specificity, area under the receiver operating characteristic curve (AUC), and likelihood ratios (LR).Results The test sample included 585 eyes of 405 participants. The median DL probability of glaucoma in eyes with GON was 99.8% versus 0.03% for normal eyes (P < 0.001), with an AUC of 0.92 and sensitivity of 77% at 95% specificity. LRs indicated that the DL algorithm provided large changes in the post-test probability of disease for the majority of eyes.Conclusions The DL algorithm had high performance to discriminate eyes with GON from normal. The newly proposed objective definition of GON used as reference standard may increase the comparability of diagnostic studies of glaucoma across devices and populations, helping to improve the development and assessment of tests in clinical practice.Competing Interest StatementFinancial disclosures FAM receives research support from Carl-Zeiss Meditec, Heidelberg Engineering, Google, Reichert and is a consultant for Allergan, Carl-Zeiss Meditec, Aeri Pharmaceuticals, Novartis, Biogen, Galimedix, Annexon, Stealth Biotherapeutics, Biozeus, Reichert and IDx. FAM also is an inventor/developer on a patent for NGoggle, Inc. IMT receives research support from Glaukos Corporation and lecture fees from Novartis and Alcon Pharmaceuticals. EBM, AAJ and SIB declare “no financial disclosures”. Funding StatementFunding supports Supported in part by National Institutes of Health/National Eye Institute grant EY029885. Role of the funding source The funding source had no involvement in study design; in the collection, analysis, or interpretation of data; in the writing of the report; or in the decision to submit the paper for publication.Author DeclarationsAll relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.YesAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe authors confirm that the data supporting the findings of this study are presented within the article and its supplementary materials