PT - JOURNAL ARTICLE AU - Soundarya Krishnan AU - Rishab Khincha AU - Lovekesh Vig AU - Tirtharaj Dash AU - Ashwin Srinivasan TI - A Case Study of Transfer of Lesion-Knowledge AID - 10.1101/2020.08.19.20178210 DP - 2020 Jan 01 TA - medRxiv PG - 2020.08.19.20178210 4099 - http://medrxiv.org/content/early/2020/08/22/2020.08.19.20178210.short 4100 - http://medrxiv.org/content/early/2020/08/22/2020.08.19.20178210.full AB - All organs in the human body are susceptible to cancer, and we now have a growing store of images of lesions in different parts of the body. This, along with the acknowledged ability of neural-network methods to analyse image data, would suggest that accurate models for lesions can now be constructed by a deep neural network. However an important difficulty arises from the lack of annotated images from various parts of the body. Our proposed approach to address the issue of scarce training data for a target organ is to apply a form of transfer learning: that is, to adapt a model constructed for one organ to another for which there are minimal or no annotations. After consultation with medical specialists, we note that there are several discriminating visual features between malignant and benign lesions that occur consistently across organs. Therefore, in principle, these features boost the case for transfer learning on lesion images across organs. However, this has never been previously investigated. In this paper, we investigate whether lesion knowledge can be transferred across organs. Specifically, as a case study, we examine the transfer of a lesion model from the brain to lungs and lungs to the brain. We evaluate the efficacy of transfer of a brain-lesion model to the lung, and the transfer of a lung-lesion model to the brain by comparing against a model constructed: (a) without model-transfer (i.e.random weights); and (b) using model-transfer from a lesion-agnostic dataset (ImageNet). In all cases, our lesion models perform substantially better. These results point to the potential utility of transferring lesionknowledge across organs other than those considered here.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis work is supported by ``The DataLab'' agreement between BITS Pilani, K.K. Birla Goa Campus and TCS Research, India. AS is a Visiting Professorial Fellow at the School of CSE, UNSW Sydney.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:no approval neededAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data used in the paper is available online. https://wiki.cancerimagingarchive.net/display/Public/LIDC-IDRI https://figshare.com/articles/brain_tumor_dataset/1512427