PT - JOURNAL ARTICLE AU - Duong, Dat AU - Johny, Anna Rose AU - Hanchard, Suzanna Ledgister AU - Fortney, Chris AU - Hellmann, Fabio AU - Hu, Ping AU - Javanmardi, Behnam AU - Moosa, Shahida AU - Patel, Tanviben AU - Persky, Susan AU - Sümer, Ömer AU - Tekendo-Ngongang, Cedrik AU - Hsieh, Tzung-Chien AU - Waikel, Rebekah L. AU - André, Elisabeth AU - Krawitz, Peter AU - Solomon, Benjamin D. TI - Human and computer attention in assessing genetic conditions AID - 10.1101/2023.07.26.23293119 DP - 2023 Jan 01 TA - medRxiv PG - 2023.07.26.23293119 4099 - http://medrxiv.org/content/early/2023/07/28/2023.07.26.23293119.short 4100 - http://medrxiv.org/content/early/2023/07/28/2023.07.26.23293119.full AB - Deep learning (DL) and other types of artificial intelligence (AI) are increasingly used in many biomedical areas, including genetics. One frequent use in medical genetics involves evaluating images of people with potential genetic conditions to help with diagnosis. A central question involves better understanding how AI classifiers assess images compared to humans. To explore this, we performed eye-tracking analyses of geneticist clinicians and non-clinicians. We compared results to DL-based saliency maps. We found that human visual attention when assessing images differs greatly from the parts of images weighted by the DL model. Further, individuals tend to have a specific pattern of image inspection, and clinicians demonstrate different visual attention patterns than non-clinicians.Competing Interest StatementThis research was supported in part by the Intramural Research Program of the National Human Genome Research Institute, National Institutes of Health. This work utilized the computational resources of the NIH HPC Biowulf cluster.Funding StatementThis research was supported in part by the Intramural Research Program of the National Human Genome Research Institute, National Institutes of Health.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was approved as exempt by the IRBs of the National Institutes of Health (Maryland, United States) and University of Bonn (Bonn, Germany).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesProcessed data produced in the present work are available in the manuscript and accompanying files, with code available via GitHub. Raw data are available upon reasonable request to the authors. https://github.com/datduong/Tobii-AOI-FaceSyndromes