Advanced Reinforcement Learning and Its Connections with Brain Neuroscience
Authors:
- 1 January 2023
- journal article
- review article
- Published by American Association for the Advancement of Science (AAAS) in Research
- Vol. 6, 0064
Abstract
In recent years, brain science and neuroscience have greatly propelled the innovation of computer science. In particular, knowledge from the neurobiology and neuropsychology of the brain revolutionized the development of reinforcement learning (RL) by providing novel interpretable mechanisms of how the brain achieves intelligent and efficient decision making. Triggered by this, there has been a boom in research about advanced RL algorithms that are built upon the inspirations of brain neuroscience. In this work, to further strengthen the bidirectional link between the 2 communities and especially promote the research on modern RL technology, we provide a comprehensive survey of recent advances in the area of brain-inspired/related RL algorithms. We start with basis theories of RL, and present a concise introduction to brain neuroscience related to RL. Then, we classify these advanced RL methodologies into 3 categories according to different connections of the brain, i.e., micro-neural activity, macro-brain structure, and cognitive function. Each category is further surveyed by presenting several modern RL algorithms along with their mathematical models, correlations with the brain, and open issues. Finally, we introduce several important applications of RL algorithms, followed by the discussions of challenges and opportunities for future research.Keywords
This publication has 83 references indexed in Scilit:
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Hierarchical reinforcement learning and decision makingCurrent Opinion in Neurobiology, 2012
- Neural Basis of Reinforcement Learning and Decision MakingAnnual Review of Neuroscience, 2012
- Behavioral and Neural Properties of Social Reinforcement LearningJournal of Neuroscience, 2011
- Neurobiology of Economic Choice: A Good-Based ModelAnnual Review of Neuroscience, 2011
- Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal ChoiceNeuron, 2011
- Interdependence of episodic and semantic memory: Evidence from neuropsychologyJournal of the International Neuropsychological Society, 2010
- Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision MakingNeuron, 2010
- Heterogeneous reward signals in prefrontal cortexCurrent Opinion in Neurobiology, 2010
- A Neural Substrate of Prediction and RewardScience, 1997