Linking neural population formatting to function
Preprint
Abstract
Animals capable of complex behaviors tend to have more distinct brain areas than simpler organisms, and artificial networks that perform many tasks tend to self-organize into modules (1-3). This suggests that different brain areas serve distinct functions supporting complex behavior. However, a common observation is that essentially anything that an animal senses, knows, or does can be decoded from neural activity in any brain area (4-6). If everything is everywhere, why have distinct areas? Here we show that the function of a brain area is more related to how different types of information are combined (formatted) in neural representations than merely whether that information is present. We compared two brain areas: the middle temporal area (MT), which is important for visual motion perception (7, 8), and the dorsolateral prefrontal cortex (dlPFC), which is linked to decision-making and reward expectation (9,10)). When monkeys based decisions on a combination of motion and reward information, both types of information were present in both areas. However, they were formatted differently: in MT, they were encoded separably, while in dlPFC, they were represented jointly in ways that reflected the monkeys' decision-making. A recurrent neural network (RNN) model that mirrored the information formatting in MT and dlPFC predicted that manipulating activity in these areas would differently affect decision-making. Consistent with model predictions, electrically stimulating MT biased choices midway between the visual motion stimulus and the preferred direction of the stimulated units (11), while stimulating dlPFC produced 'winner-take-all' decisions that sometimes reflected the visual motion stimulus and sometimes reflected the preference of the stimulated units, but never in between. These results are consistent with the tantalizing possibility that a modular structure enables complex behavior by flexibly reformatting information to accomplish behavioral goals.Keywords
This publication has 16 references indexed in Scilit:
- Abstract representations emerge in human hippocampal neurons during inferenceNature, 2024
- Neural state space alignment for magnitude generalization in humans and recurrent networksNeuron, 2021
- Decoding and perturbing decision states in real timeNature, 2021
- Distributed coding of choice, action and engagement across the mouse brainNature, 2019
- Single-trial neural dynamics are dominated by richly varied movementsNature Neuroscience, 2019
- High-dimensional geometry of population responses in visual cortexNature, 2019
- Why neurons mix: high dimensionality for higher cognitionCurrent Opinion in Neurobiology, 2016
- Context-dependent computation by recurrent dynamics in prefrontal cortexNature, 2013
- The neural systems that mediate human perceptual decision makingNature Reviews Neuroscience, 2008
- Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaqueNature Neuroscience, 1999