Abstract
Conventional histopathology involves expensive and labor intensive processes that often consume tissue samples, rendering them unavailable for other analysis. We present a novel end-to-end workflow for pathology powered by hyperspectral microscopy and deep learning. First, we developed a custom hyperspectral microscope to non-destructively image the autofluorescence of unstained tissue sections. We then train a deep learning model to use the autofluorescence to generate virtual histological stains, which avoids the cost and variability of chemical staining procedures and conserves tissue samples. We showed that the virtual images reproduce the histological features present in the real stained images using a randomized nonalcoholic steatohepatitis (NASH) scoring comparison study where both real and virtual stains are scored by pathologists. The test showed moderate to good concordance between pathologists’ scoring on corresponding real and virtual stains. Finally, we developed deep learning-based models for automated NASH clinical research network (NASH CRN) score prediction. We showed that the end-to-end automated pathology platform is comparable to pathologists for NASH CRN scoring when evaluated against the expert pathologist consensus scores. This study provides proof of concept for this virtual staining strategy, which could improve cost, efficiency, and reliability in pathology, and enable novel approaches to spatial biology research.
Competing Interest Statement
Verily Life Sciences, LLC reports 3 pending patent applications on hyperspectral microscopy, virtual staining and AI-enabled NASH scoring. C.M., P.F.W., N.S., Y.W., C.S., C.C.K., P.C., D.F. are current employees of Alphabet Inc. and own Alphabet (Google and Verily) stock as part of the standard compensation package. C.H.W., A.H., M.G., A.B., K.T. and P.H.C.C. are former employees of Alphabet and performed work for this manuscript during their tenure at Alphabet. L.F., E.B.M., S.S. are current or former employees of Allergan and AbbVie and performed work for this manuscript during their tenure at those companies. R.K.P received consulting fees from Alimentiv Inc, Allergan, Eli Lilly, Verily, and AbbVie. D.T. received consulting fees from Alimentiv Inc, Clinnovate Health UK Ltd, Allergan Plc, Verily, ICON Clinical Research Ltd, Ionis Pharmaceuticals. A.B. is scientific advisor to Avacta, GSK (for NASH studies), 3Helix, and received consulting fees from: Allergan, Verily, PathAI, 23andMe, Source Bioscience, Alimentiv, Dialectica.
Clinical Trial
NCT02217475
Funding Statement
Tobira Therapeutics, Inc. Verily Life Sciences LLC
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
wcgIRB gave ethical approval for the study in this work.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Footnotes
Only the authors and ordering has been changed to fix an error.
Data Availability
The data for the patient samples cannot be shared under the restrictions placed by the institutional review board. The data storage and retrieval infrastructure was built and managed by Google LLC.
