Neural imaging to track mental states while using an intelligent tutoring system
- 24 March 2010
- journal article
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 107 (15) , 7018-7023
Abstract
Hemodynamic measures of brain activity can be used to interpret a student's mental state when they are interacting with an intelligent tutoring system. Functional magnetic resonance imaging (fMRI) data were collected while students worked with a tutoring system that taught an algebra isomorph. A cognitive model predicted the distribution of solution times from measures of problem complexity. Separately, a linear discriminant analysis used fMRI data to predict whether or not students were engaged in problem solving. A hidden Markov algorithm merged these two sources of information to predict the mental states of students during problem-solving episodes. The algorithm was trained on data from 1 day of interaction and tested with data from a later day. In terms of predicting what state a student was in during a 2-s period, the algorithm achieved 87% accuracy on the training data and 83% accuracy on the test data. The results illustrate the importance of integrating the bottom-up information from imaging data with the top-down information from a cognitive model.Keywords
This publication has 16 references indexed in Scilit:
- Neural correlates of arithmetic calculation strategiesCognitive, Affective, & Behavioral Neuroscience, 2009
- Modeling fMRI data generated by overlapping cognitive processes with unknown onsets using Hidden Process ModelsNeuroImage, 2009
- Real-time imaging of human brain function by near-infrared spectroscopy using an adaptive general linear modelNeuroImage, 2009
- Predicting Human Brain Activity Associated with the Meanings of NounsScience, 2008
- Reading Hidden Intentions in the Human BrainCurrent Biology, 2007
- Predicting the Stream of Consciousness from Activity in Human Visual CortexCurrent Biology, 2005
- N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studiesHuman Brain Mapping, 2005
- The change of the brain activation patterns as children learn algebra equation solvingProceedings of the National Academy of Sciences, 2004
- Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal CortexScience, 2001
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989