Deep Learning-Based Detection of Learning Disorders on a Large Scale Dataset of Eye Movement Records
Open Access
- 14 February 2024
- journal article
- research article
- Published by MDPI AG in BioMedInformatics
- Vol. 4 (1) , 519-541
Abstract
Early detection of dyslexia and learning disorders is vital for avoiding a learning disability, as well as supporting dyslexic students by tailoring academic programs to their needs. Several studies have investigated using supervised algorithms to screen dyslexia vs. control subjects; however, the data size and the conditions of data acquisition were their most significant limitation. In the current study, we leverage a large dataset, containing 4243 time series of eye movement records from children across Europe. These datasets were derived from various tests such as saccade, vergence, and reading tasks. Furthermore, our methods were evaluated with realistic test data, including real-life biases such as noise, eye tracking misalignment, and similar pathologies among non-scholar difficulty classes. In addition, we present a novel convolutional neural network architecture, adapted to our time series classification problem, that is intended to generalize on a small annotated dataset and to handle a high-resolution signal (1024 point). Our architecture achieved a precision of 80.20% and a recall of 75.1%, when trained on the vergence dataset, and a precision of 77.2% and a recall of 77.5% when trained on the saccade dataset. Finally, we performed a comparison using our ML approach, a second architecture developed for a similar problem, and two other methods that we investigated that use deep learning algorithms to predict dyslexia.Keywords
Funding Information
- Orasis-Ear
This publication has 41 references indexed in Scilit:
- Gaze estimation with semi-supervised eye landmark detection as an auxiliary taskPattern Recognition, 2023
- Eye tracking based deep learning analysis for the early detection of diabetic retinopathy: A pilot studyBiomedical Signal Processing and Control, 2023
- Prediction of dyslexia severity levels from fixation and saccadic eye movement using machine learningBiomedical Signal Processing and Control, 2022
- COLET: A dataset for COgnitive workLoad estimation based on eye-trackingComputer Methods and Programs in Biomedicine, 2022
- An eye tracker based on webcam and its preliminary application evaluation in Chinese reading testsBiomedical Signal Processing and Control, 2022
- Eye tracking based dyslexia detection using a holistic approachScientific Reports, 2021
- Differential diagnosis of vergence and saccade disorders in dyslexiaScientific Reports, 2020
- Prediction of Dyslexia from Eye Movements Using Machine LearningIETE Journal of Research, 2019
- Does dyslexia exist?Language, Cognition and Neuroscience, 2017
- Automatic gaze-based user-independent detection of mind wandering during computerized readingUser Modeling and User-Adapted Interaction, 2015