Decoding movie content from neuronal population activity in the human medial temporal lobe
Authors:
- Franziska GerkenFGFranziska Gerken
- Alana DarcherADAlana Darcher
- Pedro J GonçalvesPGPedro J Gonçalves
- Rachel RappRRRachel Rapp
- Ismail EleziIEIsmail Elezi
- Johannes NiediekJNJohannes Niediek
- Marcel S KehlMKMarcel S Kehl
- Thomas P ReberTRThomas P Reber
- Stefanie LiebeSLStefanie Liebe
- Jakob H MackeJMJakob H Macke
- Florian MormannFMFlorian Mormann
- Laura Leal-TaixéLLLaura Leal-Taixé
Preprint
Abstract
The human medial temporal lobe (MTL), a region implicated in memory and high-level cognition, contains neurons that respond selectively to stimuli belonging to specific categories, such as individual people, landmarks, or objects. However, these neurons have been largely studied via static, isolated presentations of stimuli. Therefore, it is unclear how neurons in the MTL respond to rich stimuli such as movies, and which dynamical stimulus features can be retrieved from neuronal population spiking activity. We studied single-unit responses from 2286 neurons recorded from the amygdala, hippocampus, entorhinal cortex, and parahippocampal cortex of 29 intracranially implanted patients during the presentation of an 83-minute movie. We found only a few individual neurons that exhibited a classic selective response to semantic features. However, we successfully decoded the presence of characters, settings, and visual transitions from neuronal population activity. The information relevant for decoding varies across regions depending on the feature category, as visual transitions could be decoded from subsets of neurons with selective responses, whereas character and location features relied on distributed representations. Our results demonstrate an approach for reliably decoding movie features in the human MTL, and suggest that the brain uses a population code when representing character and location features.Keywords
This publication has 46 references indexed in Scilit:
- What is changing when: Decoding visual information in movies from human intracranial recordingsNeuroImage, 2018
- Single-Neuron Correlates of Conscious Perception in the Human Medial Temporal LobeCurrent Biology, 2017
- Discovering Event Structure in Continuous Narrative Perception and MemoryNeuron, 2017
- Repeating Spatial Activations in Human Entorhinal CortexCurrent Biology, 2015
- Neural population coding: combining insights from microscopic and mass signalsTrends in Cognitive Sciences, 2015
- Reconstructing Visual Experiences from Brain Activity Evoked by Natural MoviesCurrent Biology, 2011
- Nonparametric statistical testing of EEG- and MEG-dataJournal of Neuroscience Methods, 2007
- Human brain activity time-locked to perceptual event boundariesNature Neuroscience, 2001
- Category-specific visual responses of single neurons in the human medial temporal lobeNature Neuroscience, 2000
- Single Neuron Activity in Human Hippocampus and Amygdala during Recognition of Faces and ObjectsNeuron, 1997