Bridging Computation and Representation in Associative Learning
- 4 April 2025
- journal article
- research article
- Published by Springer Nature in Computational Brain & Behavior
- Vol. 8 (3) , 1-15
Abstract
Two views of Pavlovian conditioning have dominated the theoretical discourse. The classical associative view holds that associations are learned based on temporal contiguity between stimuli, and conditioned responses directly reflect associative strength. The representational view, exemplified by Rate Estimation Theory (Gallistel & Gibbon, Psychological Review, 107(2), 289–344 2000), holds that animals learn the structure of the stimulus distribution, from which a measure of contingency between stimuli is derived and used to generate conditioned responses. Unlike contiguity, contingency is a relative measure, comparing the rate of reinforcement in the presence of a stimulus to the background rate. This turns out to be crucial for explaining the effects of manipulating the background rate while holding the stimulus-conditional rate constant (i.e., changing contingency without changing contiguity). It has also been argued that contiguity theories face irremediable conceptual difficulties stemming from the coercion of continuous time into discrete bins. This paper makes two contributions to the debate. First, it shows that Rate Estimation Theory faces its own computational and conceptual problems. Second, it shows how to fix these problems while retaining the core of the theory. Surprisingly, this leads to the insight that rates can be estimated using an algorithm closely resembling a classical associative theory (the Rescorla-Wagner model). The key difference lies in the response rule rather than in the learning rule.Keywords
Funding Information
- Air Force Office of Scientific Research (FA9550-20-1-0413)
- Schmidt Sciences (Polymath award)
This publication has 59 references indexed in Scilit:
- The molecular memory code and synaptic plasticity: A synthesisBioSystems, 2023
- The Coding QuestionTrends in Cognitive Sciences, 2017
- Temporal contingencyBehavioural Processes, 2014
- Temporal maps and informativeness in associative learningTrends in Neurosciences, 2009
- Equilibria of the Rescorla–Wagner modelJournal of Mathematical Psychology, 2003
- Extinction of Comparator Stimuli during and after Acquisition: Differential Facilitative Effects on Pavlovian RespondingLearning and Motivation, 1993
- Context, time, and memory retrieval in the interference paradigms of Pavlovian learning.Psychological Bulletin, 1993
- The Comparator Hypothesis: A Response Rule for The Expression of Associations1988
- Preconditioning exposure to the unconditined stimulus affects the acquisition of a conditioned emotional responseLearning and Motivation, 1979
- CS habituation produces a “latent inhibition effect” but no active “conditioned inhibition”Learning and Motivation, 1972