Agency rescues competition for credit assignment among predictive cues from adverse learning conditions
Preprint
Abstract
A fundamental assumption of learning theories is that the credit assigned to predictive cues is not simply determined by their probability of reinforcement, but by their ability to compete with other cues present during learning. This assumption has guided behavioral and neural science research for decades, and tremendous empirical and theoretical advances have been made identifying the mechanisms of cue competition. However, when learning conditions are not optimal (e.g., when training is massed), credit assignment is no longer competitive. This is a catastrophic failure of the learning system that exposes the individual’s vulnerability to form spurious associations in the real world. Here, we uncover that cue competition can be rescued when conditions are suboptimal provided that the individual has agency over the learning experience. Our findings reveal a new connection between agency over learning and credit assignment to cues, and open new avenues of investigation into the underlying mechanisms.Keywords
All Related Versions
- Published version: Scientific Reports, 11 (1), 1.
This publication has 72 references indexed in Scilit:
- Prediction error minimization: Implications for Embodied Cognition and the Extended Mind HypothesisBrain and Cognition, 2017
- Expectancy bias in a selective conditioning procedure: Trait anxiety increases the threat value of a blocked stimulusJournal of Behavior Therapy and Experimental Psychiatry, 2012
- On the nature of CS and US representations in Pavlovian learningLearning & Behavior, 2011
- Blocking and pseudoblocking: New control experiments with honeybeesQuarterly Journal of Experimental Psychology, 2006
- A componential view of configural cues in generalization and discrimination in Pavlovian conditioningBehavioural Brain Research, 2000
- Augmentation of taste conditioning by a preconditioned odor.Journal of Experimental Psychology: Animal Behavior Processes, 1999
- Theoretical mechanisms underlying the trial-spacing effect in Pavlovian fear conditioning.Journal of Experimental Psychology: Animal Behavior Processes, 1999
- Associative processes in differentially reared rhesus monkeys (Macaca mulatta): BlockingDevelopmental Psychobiology, 1991
- Judgement of Act-Outcome Contingency: The Role of Selective AttributionThe Quarterly Journal of Experimental Psychology Section A, 1984
- A model for stimulus generalization and discrimination.Psychological Review, 1951