Eye-movement analysis on facial expression for identifying children and adults with neurodevelopmental disorders
Authors:
Open Access
- 16 February 2023
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Digital Health
- Vol. 5, 952433
Abstract
Experienced psychiatrists identify people with autism spectrum disorder (ASD) and schizophrenia (Sz) through interviews based on diagnostic criteria, their responses, and various neuropsychological tests. To improve the clinical diagnosis of neurodevelopmental disorders such as ASD and Sz, the discovery of disorder-specific biomarkers and behavioral indicators with sufficient sensitivity is important. In recent years, studies have been conducted using machine learning to make more accurate predictions. Among various indicators, eye movement, which can be easily obtained, has attracted much attention and various studies have been conducted for ASD and Sz. Eye movement specificity during facial expression recognition has been studied extensively in the past, but modeling taking into account differences in specificity among facial expressions has not been conducted. In this paper, we propose a method to detect ASD or Sz from eye movement during the Facial Emotion Identification Test (FEIT) while considering differences in eye movement due to the facial expressions presented. We also confirm that weighting using the differences improves classification accuracy. Our data set sample consisted of 15 adults with ASD and Sz, 16 controls, and 15 children with ASD and 17 controls. Random forest was used to weight each test and classify the participants as control, ASD, or Sz. The most successful approach used heat maps and convolutional neural networks (CNN) for eye retention. This method classified Sz in adults with 64.5% accuracy, ASD in adults with up to 71.0% accuracy, and ASD in children with 66.7% accuracy. Classifying of ASD result was significantly different (p<.05) by the binomial test with chance rate. The results show a 10% and 16.7% improvement in accuracy, respectively, compared to a model that does not take facial expressions into account. In ASD, this indicates that modeling is effective, which weights the output of each image.Keywords
Funding Information
- Core Research for Evolutional Science and Technology (JPMJCR19A5)
This publication has 26 references indexed in Scilit:
- Cognition sociale dans la schizophrénie et les troubles du spectre de l’autisme : points de convergences et différences fonctionnellesL'Encéphale, 2018
- Eye movement as a biomarker of schizophrenia: Using an integrated eye movement scorePsychiatry and Clinical Neurosciences, 2016
- Identifying children with autism spectrum disorder based on their face processing abnormality: A machine learning frameworkAutism Research, 2016
- Abnormality in face scanning by children with autism spectrum disorder is limited to the eye region: Evidence from multi-method analyses of eye tracking dataJournal of Vision, 2013
- Atypical scanpaths in schizophrenia: Evidence of a trait- or state-dependent phenomenon?Journal of Psychiatry and Neuroscience, 2011
- Detecting subtle facial emotion recognition deficits in high-functioning Autism using dynamic stimuli of varying intensitiesNeuropsychologia, 2010
- Scan Path Differences and Similarities During Emotion Perception in those With and Without Autism Spectrum DisordersJournal of Autism and Developmental Disorders, 2008
- Visual Scanning of Faces in AutismJournal of Autism and Developmental Disorders, 2002
- Visual scanpaths to positive and negative facial emotions in an outpatient schizophrenia sampleSchizophrenia Research, 2002
- The Positive and Negative Syndrome Scale (PANSS) for SchizophreniaSchizophrenia Bulletin, 1987