Beyond Drift Diffusion Models: Fitting a Broad Class of Decision and Reinforcement Learning Models with HDDM
- 1 September 2022
- journal article
- research article
- Published by MIT Press in Journal of Cognitive Neuroscience
- Vol. 34 (10) , 1780-1805
Abstract
Computational modeling has become a central aspect of research in the cognitive neurosciences. As the field matures, it is increasingly important to move beyond standard models to quantitatively assess models with richer dynamics that may better reflect underlying cognitive and neural processes. For example, sequential sampling models (SSMs) are a general class of models of decision-making intended to capture processes jointly giving rise to RT distributions and choice data in n-alternative choice paradigms. A number of model variations are of theoretical interest, but empirical data analysis has historically been tied to a small subset for which likelihood functions are analytically tractable. Advances in methods designed for likelihood-free inference have recently made it computationally feasible to consider a much larger spectrum of SSMs. In addition, recent work has motivated the combination of SSMs with reinforcement learning models, which had historically been considered in separate literatures. Here, we provide a significant addition to the widely used HDDM Python toolbox and include a tutorial for how users can easily fit and assess a (user-extensible) wide variety of SSMs and how they can be combined with reinforcement learning models. The extension comes batteries included, including model visualization tools, posterior predictive checks, and ability to link trial-wise neural signals with model parameters via hierarchical Bayesian regression.Keywords
Funding Information
- National Institute of Mental Health (P50 MH 119467-01)
- National Institute of Mental Health (R01 MH084840-08A1)
This publication has 64 references indexed in Scilit:
- HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in PythonFrontiers in Neuroinformatics, 2013
- The Attentional Drift-Diffusion Model Extends to Simple Purchasing DecisionsFrontiers in Psychology, 2012
- Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisionsProceedings of the National Academy of Sciences, 2011
- Cortico-striatal connections predict control over speed and accuracy in perceptual decision makingProceedings of the National Academy of Sciences, 2010
- A General Framework for the Parametrization of Hierarchical ModelsStatistical Science, 2007
- Aging, practice, and perceptual tasks: A diffusion model analysis.Psychology and Aging, 2006
- The time course of perceptual choice: The leaky, competing accumulator model.Psychological Review, 2001
- General Methods for Monitoring Convergence of Iterative SimulationsJournal of Computational and Graphical Statistics, 1998
- Inference from Iterative Simulation Using Multiple SequencesStatistical Science, 1992
- A theory of memory retrieval.Psychological Review, 1978