Gaze-Based Detection of Thoughts across Naturalistic Tasks Using a PSO-Optimized Random Forest Algorithm
Open Access
- 27 July 2024
- journal article
- research article
- Published by MDPI AG in Bioengineering
- Vol. 11 (8) , 760
Abstract
One key aspect of the human experience is our ongoing stream of thoughts. These thoughts can be broadly categorized into various dimensions, which are associated with different impacts on mood, well-being, and productivity. While the past literature has often identified eye movements associated with a specific thought dimension (task-relatedness) during experimental tasks, few studies have determined if these various thought dimensions can be classified by oculomotor activity during naturalistic tasks. Employing thought sampling, eye tracking, and machine learning, we assessed the classification of nine thought dimensions (task-relatedness, freely moving, stickiness, goal-directedness, internal–external orientation, self-orientation, others orientation, visual modality, and auditory modality) across seven multi-day recordings of seven participants during self-selected computer tasks. Our analyses were based on a total of 1715 thought probes across 63 h of recordings. Automated binary-class classification of the thought dimensions was based on statistical features extracted from eye movement measures, including fixation and saccades. These features all served as input into a random forest (RF) classifier, which was then improved with particle swarm optimization (PSO)-based selection of the best subset of features for classifier performance. The mean Matthews correlation coefficient (MCC) values from the PSO-based RF classifier across the thought dimensions ranged from 0.25 to 0.54, indicating above-chance level performance in all nine thought dimensions across participants and improved performance compared to the RF classifier without feature selection. Our findings highlight the potential of machine learning approaches combined with eye movement measures for the real-time prediction of naturalistic ongoing thoughts, particularly in ecologically valid contexts.Keywords
Funding Information
- Dutch Research Council (VI.Veni.191G.001, RO1 NSO21135, P50MH109429)
- National Institute of Neurological Disorders and Stroke (VI.Veni.191G.001, RO1 NSO21135, P50MH109429)
- Conte Center (VI.Veni.191G.001, RO1 NSO21135, P50MH109429)
- Natural Sciences and Engineering Research Council Discovery Grant (VI.Veni.191G.001, RO1 NSO21135, P50MH109429)
This publication has 59 references indexed in Scilit:
- Improving Breast Cancer Diagnosis Accuracy by Particle Swarm Optimization Feature SelectionInternational Journal of Computational Intelligence Systems, 2024
- Differential relationships between thought dimensions and momentary affect in daily lifePsychological Research, 2022
- Classification of attention levels using a Random Forest algorithm optimized with Particle Swarm OptimizationEvolving Systems, 2022
- Neurophysiological indicators of internal attention: An electroencephalography–eye‐tracking coregistration studyBrain and Behavior, 2020
- Classification of epileptic EEG signals using PSO based artificial neural network and tunable-Q wavelet transformBiocybernetics and Biomedical Engineering, 2020
- Wandering eyes: Eye movements during mind wandering in video lecturesApplied Cognitive Psychology, 2020
- Automated gaze-based mind wandering detection during computerized learning in classroomsUser Modeling and User-Adapted Interaction, 2019
- Looking for ideas: Eye behavior during goal-directed internally focused cognitionConsciousness and Cognition, 2017
- Automatic gaze-based user-independent detection of mind wandering during computerized readingUser Modeling and User-Adapted Interaction, 2015
- The eyes know what you are thinking: Eye movements as an objective measure of mind wanderingConsciousness and Cognition, 2011