Explainable Children Autism Detection using Gaze Features in Audio-Visual Speech Comprehension ETRA012
Authors:
- Miguel Zaragozá-PortolésMZMiguel Zaragozá-Portolés
- David Gimeno-GomezDGDavid Gimeno-Gomez
- Vicenta ÁvilaVÁVicenta Ávila
- Inmaculada FajardoIFInmaculada Fajardo
- Antonio FerrerAFAntonio Ferrer
- Nadina Gomez-MerinoNGNadina Gomez-Merino
- Noemi SkrobiszewskaNSNoemi Skrobiszewska
- Carlos-D. Martínez-HinarejosCarlos-D. Martínez-Hinarejos
Open Access
- 28 May 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 10 (3) , 1-18
Abstract
Autism Spectrum Disorder (ASD) is a neurodevelopmental condition marked by impairments in social interaction and delayed language acquisition. Early and accurate identification is crucial for timely interventions that support cognitive and social development. Motivated by the subjectivity of traditional behavior-based assessments, computational methodologies offer more objective and cost-effective alternatives. Among these, eye-tracking stands out for capturing subtle attentional and perceptual patterns. This paper investigates the use of eye-tracking data for automatic ASD detection in children during audio-visual storytelling interactions, emphasizing traditional yet explainable machine learning methods. Although performance remains modest, our analyses reveal that fixation duration and revisit patterns to facial regions may serve as potential biomarkers. Further analyses highlight the impact of stimulus modality, suggesting that the inclusion of visual speech cues provides valuable discriminative information. These findings have the potential to support and guide the work of psychologists in the assessment of ASD within speech comprehension contexts.Keywords
This publication has 56 references indexed in Scilit:
- Explainable AI in early autism detection: a literature review of interpretable machine learning approachesDiscover Mental Health, 2025
- Explainable and secure framework for autism prediction using multimodal eye tracking and kinematic dataComplex & Intelligent Systems, 2025
- Audiovisual temporal binding window narrows with age in autistic individualsAutism Research, 2022
- A Randomized Controlled Trial for Audiovisual Multisensory Perception in Autistic YouthJournal of Autism and Developmental Disorders, 2022
- Explainable Artificial Intelligence in Healthcare: Opportunities, Gaps and Challenges and a Novel Way to Look at the Problem Space2021
- Atypical gaze patterns to facial feature areas in autism spectrum disorders reveal age and culture effects: A meta‐analysis of eye‐tracking studiesAutism Research, 2021
- Applying Eye Tracking to Identify Autism Spectrum Disorder in ChildrenJournal of Autism and Developmental Disorders, 2018
- Preference for Geometric Patterns Early in Life as a Risk Factor for AutismArchives of General Psychiatry, 2011
- A General Method for Visualizing and Explaining Black-Box Regression Models2011
- Absence of Preferential Looking to the Eyes of Approaching Adults Predicts Level of Social Disability in 2-Year-Old Toddlers With Autism Spectrum DisorderArchives of General Psychiatry, 2008