RT Journal Article
SR Electronic
T1 Identification of social engagement indicators associated with autism spectrum disorder using a game-based mobile application
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2021.06.20.21259187
DO 10.1101/2021.06.20.21259187
A1 Maya Varma
A1 Peter Washington
A1 Brianna Chrisman
A1 Aaron Kline
A1 Emilie Leblanc
A1 Kelley Paskov
A1 Nate Stockham
A1 Jae-Yoon Jung
A1 Min Woo Sun
A1 Dennis P. Wall
YR 2021
UL http://medrxiv.org/content/early/2021/06/25/2021.06.20.21259187.abstract
AB Objective Autism spectrum disorder (ASD) is a widespread neurodevelopmental condition with a range of potential causes and symptoms. Children with ASD exhibit behavioral and social impairments, giving rise to the possibility of utilizing computational techniques to evaluate a child’s social phenotype from home videos.Methods Here, we use a mobile health application to collect over 11 hours of video footage depicting 95 children engaged in gameplay in a natural home environment. We utilize automated dataset annotations to analyze two social indicators that have previously been shown to differ between children with ASD and their neurotypical (NT) peers: (1) gaze fixation patterns and (2) visual scanning methods. We compare the gaze fixation and visual scanning methods utilized by children during a 90-second gameplay video in order to identify statistically-significant differences between the two cohorts; we then train an LSTM neural network in order to determine if gaze indicators could be predictive of ASD.Results Our work identifies one statistically significant region of fixation and one significant gaze transition pattern that differ between our two cohorts during gameplay. In addition, our deep learning model demonstrates mild predictive power in identifying ASD based on coarse annotations of gaze fixations.Discussion Ultimately, our results demonstrate the utility of game-based mobile health platforms in quantifying visual patterns and providing insights into ASD. We also show the importance of automated labeling techniques in generating large-scale datasets while simultaneously preserving the privacy of participants. Our approaches can generalize to other healthcare needs.Competing Interest StatementD.P.W. is the founder of Cognoa.com. This company is developing digital health solutions for pediatric care. A.K. works as part-time consultant to Cognoa.com. All other authors declare no competing interests.Funding StatementThis work was supported by funds awarded to MV and DPW from Bio-X, the PHIND Center, and the Institute for Human-Centered Artificial Intelligence at Stanford University. MV is supported by the Knight-Hennessy Scholars program at Stanford University and the National Defense Science and Engineering Graduate (NDSEG) Fellowship. Funding sources played no role in study design; collection, analysis, and interpretation of data; writing of the manuscript; and in the decision to submit the study for publication.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The study protocol was approved by the Stanford University Institutional Review Board. All participants provided informed consent electronically.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesIn order to protect participant privacy, raw videos are not made publicly available at this time.