Characterizing Learning by Simultaneous Analysis of Continuous and Binary Measures of Performance
Authors:
- 1 November 2009
- journal article
- Published by American Physiological Society in Journal of Neurophysiology
- Vol. 102 (5) , 3060-3072
Abstract
Continuous observations, such as reaction and run times, and binary observations, such as correct/incorrect responses, are recorded routinely in behavioral learning experiments. Although both types of performance measures are often recorded simultaneously, the two have not been used in combination to evaluate learning. We present a state-space model of learning in which the observation process has simultaneously recorded continuous and binary measures of performance. We use these performance measures simultaneously to estimate the model parameters and the unobserved cognitive state process by maximum likelihood using an approximate expectation maximization (EM) algorithm. We introduce the concept of a reaction-time curve and reformulate our previous definitions of the learning curve, the ideal observer curve, the learning trial and between-trial comparisons of performance in terms of the new model. We illustrate the properties of the new model in an analysis of a simulated learning experiment. In the simulated data analysis, simultaneous use of the two measures of performance provided more credible and accurate estimates of the learning than either measure analyzed separately. We also analyze two actual learning experiments in which the performance of rats and of monkeys was tracked across trials by simultaneously recorded reaction and run times and the correct and incorrect responses. In the analysis of the actual experiments, our algorithm gave a straightforward, efficient way to characterize learning by combining continuous and binary measures of performance. This analysis paradigm has implications for characterizing learning and for the more general problem of combining different data types to characterize the properties of a neural system.Keywords
This publication has 37 references indexed in Scilit:
- Quantification of the benefit from integrating MEG and EEG data in minimum ℓ2-norm estimationNeuroImage, 2008
- A mixed filter algorithm for cognitive state estimation from simultaneously recorded continuous and binary measures of performanceBiological Cybernetics, 2008
- Bayesian Analysis of Interleaved Learning and Response Bias in Behavioral ExperimentsJournal of Neurophysiology, 2007
- Neuronal ensemble control of prosthetic devices by a human with tetraplegiaNature, 2006
- Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor LearningPLOS Biology, 2006
- Activity of striatal neurons reflects dynamic encoding and recoding of procedural memoriesNature, 2005
- Functional Magnetic Resonance Imaging Activity during the Gradual Acquisition and Expression of Paired-Associate MemoryThe Journal of Neuroscience, 2005
- Acquisition and extinction in autoshaping.Psychological Review, 2002
- Monte Carlo EM Estimation for Time Series Models Involving CountsJournal of the American Statistical Association, 1995
- Acquisition and retention by hippocampal rats of simple, conditional, and configural tasks using tactile and olfactory cues: Implications for hippocampal function.Behavioral Neuroscience, 1991