How do animals weigh conflicting information about reward sources over time? Comparing dynamic averaging models
Open Access
- 2 March 2024
- journal article
- research article
- Published by Springer Nature in Animal Cognition
- Vol. 27 (1) , 1-15
Abstract
Optimal foraging theory suggests that animals make decisions which maximize their food intake per unit time when foraging, but the mechanisms animals use to track the value of behavioral alternatives and choose between them remain unclear. Several models for how animals integrate past experience have been suggested. However, these models make differential predictions for the occurrence of spontaneous recovery of choice: a behavioral phenomenon in which a hiatus from the experimental environment results in animals reverting to a behavioral allocation consistent with a reward distribution from the more distant past, rather than one consistent with their most recently experienced distribution. To explore this phenomenon and compare these models, three free-operant experiments with rats were conducted using a serial reversal design. In Phase 1, two responses (A and B) were baited with pellets on concurrent variable interval schedules, favoring option A. In Phase 2, lever baiting was reversed to favor option B. Rats then entered a delay period, where they were maintained at weight in their home cages and no experimental sessions took place. Following this delay, preference was assessed using initial responding in test sessions where levers were presented, but not baited. Models were compared in performance, including an exponentially weighted moving average, the Temporal Weighting Rule, and variants of these models. While the data provided strong evidence of spontaneous recovery of choice, the form and extent of recovery was inconsistent with the models under investigation. Potential interpretations are discussed in relation to both the decision rule and valuation functions employed.Keywords
Funding Information
- Eunice K. Shriver National Institute of Child Health and Human Development (R01HD093734 (TAS), R01HD093734 (TAS))
This publication has 64 references indexed in Scilit:
- Memory for Extinction of Conditioned Fear Is Long-lasting and Persists Following Spontaneous RecoveryLearning & Memory, 2002
- A retrieval cue for extinction attenuates spontaneous recovery.Journal of Experimental Psychology: Animal Behavior Processes, 1993
- Memory and the efficient use of informationJournal of Theoretical Biology, 1987
- The Integration of Reinforcements over TimeAnnals of the New York Academy of Sciences, 1984
- CHOICE, EXPERIENCE, AND THE GENERALIZED MATCHING LAWJournal of the Experimental Analysis of Behavior, 1983
- Learning the evolutionarily stable strategyJournal of Theoretical Biology, 1981
- The application of statistical decision theory to animal behaviourJournal of Theoretical Biology, 1980
- MATCHING, UNDERMATCHING, AND OVERMATCHING IN STUDIES OF CHOICEJournal of the Experimental Analysis of Behavior, 1979
- Spontaneous Recovery in Rabbit Eyelid ConditioningThe Journal of General Psychology, 1978
- Spontaneous Recovery of the Conditioned Eyelid ResponseThe Journal of General Psychology, 1958