Covariance, feedback, and discounting in ratio schedules
- 26 January 2022
- journal article
- research article
- Published by Wiley in Journal of the Experimental Analysis of Behavior
- Vol. 117 (2) , 123-150
Abstract
Action–outcome relations in the everyday world are often looser than the relations programmed in the laboratory. Reinforcement theory addressed this looseness by theorizing about “delay of reinforcement.” Response–reinforcer interval affects response rate and choice, but need not be thought of as delay. Experiments on temporal discounting are often said to reveal effects of delay also, but the intervals chosen differ from delays, because an outcome after a week, month, or year occurs after life has continued and many events have intervened. They are better called lag intervals. The present experiment studied the effects of varying lag interval on pigeons' responding on ratio‐like schedules of food. In a continuous procedure, a lag interval separated pecking that earned food from delivery of the food earned. In one series of conditions, the relation was fixed equivalent to variable‐ratio (VR) 40 while the lag interval varied. In a second series, the equivalent VR varied while the lag interval was fixed. The results accorded with matching theory, but with a factor for temporal discounting or loose feedback. The results suggest that both temporal discounting and probability discounting may be characterized within matching theory, but that temporal discounting requires a separate treatment from probability discounting.Keywords
Funding Information
- National Institute of Mental Health
- National Science Foundation of Sri Lanka
This publication has 45 references indexed in Scilit:
- RETHINKING REINFORCEMENT: ALLOCATION, INDUCTION, AND CONTINGENCYJournal of the Experimental Analysis of Behavior, 2012
- DELAY DISCOUNTING: I'M A K, YOU'RE A KJournal of the Experimental Analysis of Behavior, 2011
- Differences in delay discounting between smokers and nonsmokers remain when both rewards are delayedPsychopharmacology, 2011
- Delay discounting of real and hypothetical rewards III: Steady-state assessments, forced-choice trials, and all real rewardsBehavioural Processes, 2005
- AREA UNDER THE CURVE AS A MEASURE OF DISCOUNTINGJournal of the Experimental Analysis of Behavior, 2001
- BEYOND THE MOLAR—MOLECULAR DISTINCTION: WE NEED MULTISCALED ANALYSESJournal of the Experimental Analysis of Behavior, 2001
- THE ROLE OF THE RESPONSE—REINFORCER RELATION IN DELAY‐OF‐REINFORCEMENT EFFECTSJournal of the Experimental Analysis of Behavior, 1999
- Self-control: Beyond commitmentBehavioral and Brain Sciences, 1995
- DEFINITION IN BEHAVIORAL SCIENCE: A REVIEW OF B. B. WOLMAN'S DICTIONARY OF BEHAVIORAL SCIENCE1Journal of the Experimental Analysis of Behavior, 1974
- Fundamental dimensional properties of the operant.Psychological Review, 1958