PT - JOURNAL ARTICLE AU - Adam G. Berman AU - William R. Orchard AU - Marcel Gehrung AU - Florian Markowetz TI - PathML: A unified framework for whole-slide image analysis with deep learning AID - 10.1101/2021.07.07.21260138 DP - 2021 Jan 01 TA - medRxiv PG - 2021.07.07.21260138 4099 - http://medrxiv.org/content/early/2021/07/13/2021.07.07.21260138.short 4100 - http://medrxiv.org/content/early/2021/07/13/2021.07.07.21260138.full AB - The inspection of stained tissue slides by pathologists is essential for the early detection, diagnosis and monitoring of disease. Recently, deep learning methods for the analysis of whole-slide images (WSIs) have shown excellent performance on these tasks, and have the potential to substantially reduce the workload of pathologists. However, successful implementation of deep learning for WSI analysis is complex and requires careful consideration of model hyperparameters, slide and image artefacts, and data augmentation. Here we introduce PathML, a Python library for performing preand post-processing of WSIs, which has been designed to interact with the most widely used deep learning libraries, PyTorch and TensorFlow, thus allowing seamless integration into deep learning workflows. We present the current best practices in deep learning for WSI analysis, and give a step-by-step guide using the PathML framework: from annotating and pre-processing of slides, to implementing neural network architectures, to training and post-processing. PathML provides a unified framework in which deep learning methods for WSI analysis can be developed and applied, thus increasing the accessibility of an important new application of deep learning.Competing Interest StatementM.G. is an employee and shareholder of Cyted Ltd. F.M. is the founder and director of Tailor Bio.Funding StatementThis research was supported by Cancer Research UK (FM: C14303/A17197). A.B. acknowledges support from a Gates Cambridge Scholarship from the Gates Foundation. W.O. acknowledges support from a Peterhouse Studentship from Peterhouse, Cambridge. M.G. acknowledges support from an Enrichment Fellowship from the Alan Turing Institute.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:N/AAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesCODE AVAILABILITY: The source code of PathML is freely available at the following public repository: https://github.com/markowetzlab/pathml. The source code of the tutorial presented in the Procedure section of the manuscript is also freely available at the following public repository: https://github.com/markowetzlab/pathml-tutorial. That repository also contains the code used to train PathML's deep tissue detector in its "deep_tissue_detector" subdirectory. DATA AVAILABILITY: The whole-slide images (WSIs) used in the tutorial presented in the Procedure section, along with the annotation files demarcating regions of metastasis in each WSI, are publicly available at the following link: https://drive.google.com/drive/folders/0BzsdkU4jWx9Ba2x1NTZhdzQ5Zjg?resourcekey=0-g2TRih6YKi5P2O1SiBB1LA. Note that the "annotations" directory in the pathml-tutorial repository (https://github.com/markowetzlab/pathml-tutorial) contains corrected versions of some of the annotation files present in the CAMELYON16 Google Drive link above (some of the original annotation files contained small self-overlapping regions), so the .xml files in "annotations" are recommended in lieu of the originals. A copy of the results from a full Procedure run can be found at the pathml-tutorial repository. A complete run of the tutorial presented in the Procedure section of the manuscript include all outputs can be found at the following link: https://doi.org/10.5281/zenodo.5006409. The WSIs used to train PathML's deep tissue detector are governed by data usage policies specified by the data controller (University of Cambridge, Cancer Research UK). We are committed to complying with Cancer Research UK's Data Sharing and Preservation Policy. Whole-slide images used in this study will be available for non-commercial research purposes upon approval by a Data Access Committee according to institutional requirements. Applications for data access should be directed to florian.markowetz{at}cruk.cam.ac.uk. The annotation .xml files corresponding to these WSIs are publicly available in the "deep_tissue_detector" subdirectory of the pathml-tutorial repository. https://github.com/markowetzlab/pathml https://github.com/markowetzlab/pathml-tutorial https://drive.google.com/drive/folders/0BzsdkU4jWx9Ba2x1NTZhdzQ5Zjg?resourcekey=0-g2TRih6YKi5P2O1SiBB1LA https://doi.org/10.5281/zenodo.5006409