TY - JOUR T1 - Deep Learning-Based Universal Expert-Level Recognizing Pathological Images of Hepatocellular Carcinoma and beyond JF - medRxiv DO - 10.1101/2020.03.22.20041178 SP - 2020.03.22.20041178 AU - Wei-Ming Chen AU - Min Fu AU - Cheng-Ju Zhang AU - Qing-Qing Xing AU - Fei Zhou AU - Meng-Jie Lin AU - Xuan Dong AU - Qi-Zhong Zheng AU - Mei-Zhu Hong AU - Jin-Shui Pan Y1 - 2020/01/01 UR - http://medrxiv.org/content/early/2020/04/05/2020.03.22.20041178.abstract N2 - Purpose Human-based medical-image interpretation always falls into the predicament between specialized practitioners and expanding medical imaging. We aim at developing a diagnostic tool for pathological-image classification by using transfer learning that can be applied to diverse tumor types.Experimental Design In this study, images were retrospectively collected and prospectively analyzed using machine learning. Microscopic images of liver tissue that show or do not show hepatocellular carcinoma were used to train and validate a classification framework based on convolutional neural network. To evaluate the universal classification performance of the artificial-intelligence (AI) framework, histological images from colorectal tissue and breast were also collected. Training and validation set of images were collected from Xiamen Hospital of Traditional Chinese Medicine whereas test set of images were collected from Zhongshan Hospital Xiamen University.Results Accuracy, sensitivity, and specificity were reported and compared to human image interpretation and other AI image classification systems such as AlexNet and GoogLeNet. For the test dataset, sensitivity, specificity, and area under the curve of the AI framework were 99.1%, 98.0%, and 0.960, respectively. In human-machine comparisons, the accuracy of the AI framework was 98.5%, while the accuracy of human experts fluctuated between 93.0% and 95.0%. Based on transfer learning, the AI framework accuracy for colorectal carcinoma, breast invasive ductal carcinoma, were 96.8%, and 96.0%, respectively.Conclusions The performance of the proposed AI framework in classifying histological images with hepatocellular carcinoma is comparable to the classification by human experts. With limited training, the proposed AI framework has potential universality in histological image classification.WHAT IS KNOWNWHAT IS KNOWN✓ Accurate recognition of medical images is the basis for clinical decision-making.✓ Unresolved challenge exists between specialized practitioners and expanding medical imaging output.WHAT IS NEW HEREWHAT IS NEW HERE✓ Proposed AI framework has excellent performance in classifying hepatocellular carcinoma.✓ The AI framework has universal feature in classifying other types of histological images.✓ The AI framework may help to interpret emerging imaging technology.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialNoneFunding StatementThis work was supported by the National Natural Science Foundation of China No.81871645 (J.S.P.). The funding sources did not have any role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.Author DeclarationsAll relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.YesAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesNoneHCCHepatocellular carcinomaCRCcolorectal cancerBIDCbreast invasive ductal carcinomaAIartificial intelligence ER -