Adaptive Cognitive Training with Reinforcement Learning
Open Access
- 4 March 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 12 (1) , 1-29
Abstract
Computer-assisted cognitive training can help patients affected by several illnesses alleviate their cognitive deficits or healthy people improve their mental performance. In most computer-based systems, training sessions consist of graded exercises, which should ideally be able to gradually improve the trainee’s cognitive functions. Indeed, adapting the difficulty of the exercises to how individuals perform in their execution is crucial to improve the effectiveness of cognitive training activities. In this article, we propose the use of reinforcement learning (RL) to learn how to automatically adapt the difficulty of computerized exercises for cognitive training. In our approach, trainees’ performance in performed exercises is used as a reward to learn a policy that changes over time the values of the parameters that determine exercise difficulty. We illustrate a method to be initially used to learn difficulty-variation policies tailored for specific categories of trainees, and then to refine these policies for single individuals. We present the results of two user studies that provide evidence for the effectiveness of our method: a first study, in which a student category policy obtained via RL was found to have better effects on the cognitive function than a standard baseline training that adopts a mechanism to vary the difficulty proposed by neuropsychologists, and a second study, demonstrating that adding an RL-based individual customization further improves the training process.Keywords
This publication has 44 references indexed in Scilit:
- Computerized working memory training: Can it lead to gains in cognitive skills in students?Computers in Human Behavior, 2013
- A computational model of use-dependent motor recovery following a stroke: Optimizing corticospinal activations via reinforcement learning can explain residual capacity and other strength recovery dynamicsNeural Networks, 2012
- Training of attention functions in children with attention deficit hyperactivity disorderADHD Attention Deficit and Hyperactivity Disorders, 2011
- Computer-Based, Personalized Cognitive Training versus Classical Computer Games: A Randomized Double-Blind Prospective Trial of Cognitive StimulationNeuroepidemiology, 2011
- A randomized, controlled trial of computer-assisted cognitive remediation for schizophreniaSchizophrenia Research, 2011
- Personalised context-aware ubiquitous learning system for supporting effective English vocabulary learningInteractive Learning Environments, 2010
- Intelligent Systems2010
- A comprehensive review of the Paced Auditory Serial Addition Test (PASAT)Archives of Clinical Neuropsychology, 2006
- Mild Cognitive Impairment as a Clinical Entity and Treatment TargetArchives of Neurology, 2005
- Adaptive psychophysical proceduresVision Research, 1995