Gaze Decoding with Sensory and Motor Cortical Activity
Open Access
- 4 June 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Abstract
Eye movements require neuronal processing of visual stimuli and transmission of motor commands to the eye muscles. The brain circuitry and cortical regions responsible for sensory-motor transformations are generally understood, but deciphering the specific neuronal patterns underlying particular eye movements remains challenging. We used high-resolution eye tracking, invasive neuronal recordings, and machine learning to reveal, for the first time, the information encoded within neuronal populations in sensory and motor cortical areas that governs gaze behavior. We achieved high prediction accuracy when decoding continuous eye position using spiking activity. Decoders trained with only sensory or motor activity showed roughly equal performance, and we explored other methods of combining activity into a single model to enhance performance. Our results estimate the upper bound on decoding accuracy using brain recordings, shed light on sensory and motor cortical signals for gaze decoding, and offer insights into harnessing spatially broader brain signals for brain-computer interfaces.Keywords
Funding Information
- Whitehall Foundation
- NEI (P30EY08098)
- National Institutes of Health: NEI (T32EY17271)
This publication has 13 references indexed in Scilit:
- Decoding movement kinematics from EEG using an interpretable convolutional neural networkComputers in Biology and Medicine, 2023
- A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networksExpert Systems with Applications, 2022
- Single cortical neurons as deep artificial neural networksNeuron, 2021
- Decoding Saccade Intention From Primate Prefrontal Cortical Local Field Potentials Using Spectral, Spatial, and Temporal Dimensionality ReductionInternational Journal of Neural Systems, 2021
- Tuning characteristics of low-frequency EEG to positions and velocities in visuomotor and oculomotor tracking tasksScientific Reports, 2018
- Principal components of hand kinematics and neurophysiological signals in motor cortex during reach to grasp movementsJournal of Neurophysiology, 2014
- Commentary: Saccadic eye movements: overview of neural circuitry2002
- Long Short-Term MemoryNeural Computation, 1997
- Implantation of magnetic search coils for measurement of eye position: An improved methodVision Research, 1980
- A Method of Measuring Eye Movemnent Using a Scieral Search Coil in a Magnetic FieldIEEE Transactions on Bio-medical Electronics, 1963