A large and rich EEG dataset for modeling human visual object recognition
Preprint
Abstract
The human brain achieves visual object recognition through multiple stages of nonlinear transformations operating at a millisecond scale. To predict and explain these rapid transformations, computational neuroscientists employ machine learning modeling techniques. However, state-of-the-art models require massive amounts of data to properly train, and to the present day there is a lack of vast brain datasets which extensively sample the temporal dynamics of visual object recognition. Here we collected a large and rich dataset of high temporal resolution EEG responses to images of objects on a natural background. This dataset includes 10 participants, each with 82,160 trials spanning 16,740 image conditions. Through computational modeling we established the quality of this dataset in five ways. First, we trained linearizing encoding models that successfully synthesized the EEG responses to arbitrary images. Second, we correctly identified the recorded EEG data image conditions in a zero-shot fashion, using EEG synthesized responses to hundreds of thousands of candidate image conditions. Third, we show that both the high number of conditions as well as the trial repetitions of the EEG dataset contribute to the trained models’ prediction accuracy. Fourth, we built encoding models whose predictions well generalize to novel participants. Fifth, we demonstrate full end-to-end training of randomly initialized DNNs that output M/EEG responses for arbitrary input images. We release this dataset as a tool to foster research in visual neuroscience and computer vision.Keywords
All Related Versions
- Published version: NeuroImage, 264, 119754.
This publication has 67 references indexed in Scilit:
- Brain-inspired models for visual object recognition: an overviewArtificial Intelligence Review, 2022
- Extensive sampling for complete models of individual brainsCurrent Opinion in Behavioral Sciences, 2021
- Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural NetworkNeural Networks, 2021
- Going in circles is the way forward: the role of recurrence in visual inferenceCurrent Opinion in Neurobiology, 2020
- Interpreting encoding and decoding modelsCurrent Opinion in Neurobiology, 2019
- Fixed versus mixed RSA: Explaining visual representations by fixed and mixed feature sets from shallow and deep computational modelsJournal of Mathematical Psychology, 2017
- A primer on encoding models in sensory neuroscienceJournal of Mathematical Psychology, 2017
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Separate visual pathways for perception and actionTrends in Neurosciences, 1992
- Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition1982