Validation and Comparison of Non-stationary Cognitive Models: A Diffusion Model Application
Open Access
- 8 October 2024
- journal article
- research article
- Published by Springer Nature in Computational Brain & Behavior
- Vol. 8 (2) , 191-210
Abstract
Cognitive processes undergo various fluctuations and transient states across different temporal scales. Superstatistics are emerging as a flexible framework for incorporating such non-stationary dynamics into existing cognitive model classes. In this work, we provide the first experimental validation of superstatistics and formal comparison of four non-stationary diffusion decision models in a specifically designed perceptual decision-making task. Task difficulty and speed-accuracy trade-off were systematically manipulated to induce expected changes in model parameters. To validate our models, we assess whether the inferred parameter trajectories align with the patterns and sequences of the experimental manipulations. To address computational challenges, we present novel deep learning techniques for amortized Bayesian estimation and comparison of models with time-varying parameters. Our findings indicate that transition models incorporating both gradual and abrupt parameter shifts provide the best fit to the empirical data. Moreover, we find that the inferred parameter trajectories closely mirror the sequence of experimental manipulations. Posterior re-simulations further underscore the ability of the models to faithfully reproduce critical data patterns. Accordingly, our results suggest that the inferred non-stationary dynamics may reflect actual changes in the targeted psychological constructs. We argue that our initial experimental validation paves the way for the widespread application of superstatistics in cognitive modeling and beyond.Keywords
All Related Versions
Funding Information
- Universität Heidelberg
This publication has 75 references indexed in Scilit:
- Graphical test for discrete uniformity and its applications in goodness-of-fit evaluation and multiple sample comparisonStatistics and Computing, 2022
- Hidden Markov Models of Evidence Accumulation in Speeded Decision TasksComputational Brain & Behavior, 2021
- Models of sustained attentionCurrent Opinion in Psychology, 2019
- When humans behave like monkeys: Feedback delays and extensive practice increase the efficiency of speeded decisionsCognition, 2019
- Modeling the dynamics of recognition memory testing with an integrated model of retrieval and decision makingCognitive Psychology, 2018
- Experimental validation of the diffusion model based on a slow response time paradigmPsychological Research, 2017
- Empirical validation of the diffusion model for recognition memory and a comparison of parameter-estimation methodsPsychological Research, 2014
- Hierarchical Bayes Models for Response Time DataPsychometrika, 2010
- The simplest complete model of choice response time: Linear ballistic accumulationCognitive Psychology, 2008
- Superstatistics: theory and applicationsContinuum Mechanics and Thermodynamics, 2004