Sequence labelling and sequence classification with gaze: Novel uses of eye‐tracking data for Natural Language Processing
Authors:
- 22 September 2020
- journal article
- research article
- Published by Wiley in Language and Linguistics Compass
- Vol. 14 (11) , 1-16
Abstract
Eye‐tracking data from reading provide a structured signal with a fine‐grained temporal resolution which closely follows the sequential structure of the text. It is highly correlated with the cognitive load associated with different stages of human, cognitive text processing. While eye‐tracking data have been extensively studied to understand human cognition, it has only recently been considered for Natural Language Processing (NLP). In this review, we provide a comprehensive overview of how gaze data are being used in data‐driven NLP, in particular for sequence labelling and sequence classification tasks. We argue that eye‐tracking may effectively counter one of the core challenges of machine‐learning‐based NLP: the scarcity of annotated data. We outline the recent advances in gaze‐augmented NLP to discuss how the gaze signal from human readers can be leveraged while also considering the potentials and limitations of this data source.Keywords
This publication has 68 references indexed in Scilit:
- What is the scanpath signature of syntactic reanalysis?Journal of Memory and Language, 2011
- Evaluation of NLP Systems2010
- On-line contextual influences during reading normal text: The role of nouns, verbs and adjectivesVision Research, 2009
- Data from eye-tracking corpora as evidence for theories of syntactic processing complexityCognition, 2008
- Eye movements of young and older adults during reading.Psychology and Aging, 2007
- Eye Movements as Reflections of Comprehension Processes in ReadingScientific Studies of Reading, 2006
- Heavy NP shift is the parser’s last resort: Evidence from eye movements☆Journal of Memory and Language, 2006
- Reading morphologically complex clause structures in FinnishThe European Journal of Cognitive Psychology, 2001
- Asymmetry of the effective visual field in readingPerception & Psychophysics, 1980
- Visual attention in reading: Eye movements reflect cognitive processesMemory & Cognition, 1977