RT Journal Article
SR Electronic
T1 Human and computer attention in assessing genetic conditions
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2023.07.26.23293119
DO 10.1101/2023.07.26.23293119
A1 Duong, Dat
A1 Johny, Anna Rose
A1 Hanchard, Suzanna Ledgister
A1 Fortney, Chris
A1 Hellmann, Fabio
A1 Hu, Ping
A1 Javanmardi, Behnam
A1 Moosa, Shahida
A1 Patel, Tanviben
A1 Persky, Susan
A1 Sümer, Ömer
A1 Tekendo-Ngongang, Cedrik
A1 Hsieh, Tzung-Chien
A1 Waikel, Rebekah L.
A1 André, Elisabeth
A1 Krawitz, Peter
A1 Solomon, Benjamin D.
YR 2023
UL http://medrxiv.org/content/early/2023/07/28/2023.07.26.23293119.abstract
AB Deep learning (DL) and other types of artificial intelligence (AI) are increasingly used in many biomedical areas, including genetics. One frequent use in medical genetics involves evaluating images of people with potential genetic conditions to help with diagnosis. A central question involves better understanding how AI classifiers assess images compared to humans. To explore this, we performed eye-tracking analyses of geneticist clinicians and non-clinicians. We compared results to DL-based saliency maps. We found that human visual attention when assessing images differs greatly from the parts of images weighted by the DL model. Further, individuals tend to have a specific pattern of image inspection, and clinicians demonstrate different visual attention patterns than non-clinicians.Competing Interest StatementThis research was supported in part by the Intramural Research Program of the National Human Genome Research Institute, National Institutes of Health. This work utilized the computational resources of the NIH HPC Biowulf cluster.Funding StatementThis research was supported in part by the Intramural Research Program of the National Human Genome Research Institute, National Institutes of Health.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was approved as exempt by the IRBs of the National Institutes of Health (Maryland, United States) and University of Bonn (Bonn, Germany).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesProcessed data produced in the present work are available in the manuscript and accompanying files, with code available via GitHub. Raw data are available upon reasonable request to the authors. https://github.com/datduong/Tobii-AOI-FaceSyndromes