A Comparison of Reinforcement Learning Models for the Iowa Gambling Task Using Parameter Space Partitioning
Authors:
- Helen SteingroeverHSHelen Steingroever
- Ruud WetzelsRWRuud Wetzels
- Eric-Jan WagenmakersEWEric-Jan Wagenmakers
Open Access
- 18 April 2013
- journal article
- Published by Purdue University (bepress) in The Journal of Problem Solving
- Vol. 5 (2) , 2
Abstract
The Iowa gambling task (IGT) is one of the most popular tasks used to study decisionmaking deficits in clinical populations. In order to decompose performance on the IGT in its constituent psychological processes, several cognitive models have been proposed (e.g., the Expectancy Valence (EV) and Prospect Valence Learning (PVL) models). Here we present a comparison of three models—the EV and PVL models, and a combination of these models (EV-PU)—based on the method of parameter space partitioning. This method allows us to assess the choice patterns predicted by the models across their entire parameter space. Our results show that the EV model is unable to account for a frequency-of-losses effect, whereas the PVL and EV-PU models are unable to account for a pronounced preference for the bad decks with many switches. All three models underrepresent pronounced choice patterns that are frequently seen in experiments. Overall, our results suggest that the search of an appropriate IGT model has not yet come to an end.Keywords
This publication has 60 references indexed in Scilit:
- Cognitive decision modelling of emotion-based learning impairment in schizophrenia: The role of awarenessPsychiatry Research, 2012
- Anticipatory stress restores decision-making deficits in heavy drinkers by increasing sensitivity to lossesDrug and Alcohol Dependence, 2011
- Recency gets larger as lesions move from anterior to posterior locations within the ventromedial prefrontal cortexBehavioural Brain Research, 2010
- Decision-making and cognitive abilities: A review of associations between Iowa Gambling Task performance, executive functions, and intelligenceClinical Psychology Review, 2010
- Non-specific effects of methylphenidate (Ritalin) on cognitive ability and decision-making of ADHD and healthy adultsPsychopharmacology, 2010
- Decision making in bipolar disorder: A cognitive modeling approachPsychiatry Research, 2008
- Evaluating generalizability and parameter consistency in learning modelsGames and Economic Behavior, 2008
- Neuropsychological frontal impairments and negative symptoms in schizophreniaPsychiatry Research, 2007
- Evaluating the reliance on past choices in adaptive learning modelsJournal of Mathematical Psychology, 2007
- The somatic marker hypothesis: A critical evaluationNeuroscience & Biobehavioral Reviews, 2006