Simon Hong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Simon Hong has a total of 1 co-authors. Here are the top co-authors by number of shared publications:
Okihide Hikosaka
Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology Cambridge, MA, USA
2 shared publications
Latest Publications
- Open Access
- 1 January 2013
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 7, 854
Dopamine system: manager of neural pathways
There are a growing number of roles that midbrain dopamine (DA) neurons assume, such as, reward, aversion, alerting and vigor. Here I propose a theory that may be able to explain why the suggested functions of DA came about. It has been suggested that largely parallel cortico-basal ganglia-thalamo-cortico loops exist to control different aspects of behavior. I propose that (1) the midbrain DA system is organized in a similar manner, with different groups of DA neurons corresponding to these parallel neural pathways (NPs). The DA system can be viewed as the “manager” of these parallel NPs in that it recruits and activates only the task-relevant NPs when they are needed. It is likely that the functions of those NPs that have been consistently activated by the corresponding DA groups are facilitated. I also propose that (2) there are two levels of DA roles: the How and What roles. The How role is encoded in tonic and phasic DA neuron firing patterns and gives a directive to its target NP: how vigorously its function needs to be carried out. The tonic DA firing is to maintain a certain level of DA in the target NPs to support their expected behavioral and mental functions; it is only when a sudden unexpected boost or suppression of activity is required by the relevant target NP that DA neurons in the corresponding NP act in a phasic manner. The What role is the implementational aspect of the role of DA in the target NP, such as binding to D1 receptors to boost working memory. This What aspect of DA explains why DA seems to assume different functions depending on the region of the brain in which it is involved. In terms of the role of the lateral habenula (LHb), the LHb is expected to suppress maladaptive behaviors and mental processes by controlling the DA system. The demand-based smart management by the DA system may have given animals an edge in evolution with adaptive behaviors and a better survival rate in resource-scarce situations.
- 1 January 2013
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 7, 854
Open AccessDopamine system: manager of neural pathways
There are a growing number of roles that midbrain dopamine (DA) neurons assume, such as, reward, aversion, alerting and vigor. Here I propose a theory that may be able to explain why the suggested functions of DA came about. It has been suggested that largely parallel cortico-basal ganglia-thalamo-cortico loops exist to control different aspects of behavior. I propose that (1) the midbrain DA system is organized in a similar manner, with different groups of DA neurons corresponding to these parallel neural pathways (NPs). The DA system can be viewed as the “manager” of these parallel NPs in that it recruits and activates only the task-relevant NPs when they are needed. It is likely that the functions of those NPs that have been consistently activated by the corresponding DA groups are facilitated. I also propose that (2) there are two levels of DA roles: the How and What roles. The How role is encoded in tonic and phasic DA neuron firing patterns and gives a directive to its target NP: how vigorously its function needs to be carried out. The tonic DA firing is to maintain a certain level of DA in the target NPs to support their expected behavioral and mental functions; it is only when a sudden unexpected boost or suppression of activity is required by the relevant target NP that DA neurons in the corresponding NP act in a phasic manner. The What role is the implementational aspect of the role of DA in the target NP, such as binding to D1 receptors to boost working memory. This What aspect of DA explains why DA seems to assume different functions depending on the region of the brain in which it is involved. In terms of the role of the lateral habenula (LHb), the LHb is expected to suppress maladaptive behaviors and mental processes by controlling the DA system. The demand-based smart management by the DA system may have given animals an edge in evolution with adaptive behaviors and a better survival rate in resource-scarce situations.
- Open Access
- 1 January 2013
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 7
Diverse sources of reward value signals in the basal ganglia nuclei transmitted to the lateral habenula in the monkey
The lateral habenula (LHb) plays an important role in motivational decision making. Neurons in the primate LHb signal negative ‘reward prediction errors’ and inhibit midbrain dopamine (DA) neurons. These negative reward prediction error signals in the LHb are, at least partly, provided by a distinct group of neurons in the border region of the globus pallidus internal segment (GPb). However, it is still unclear whether other basal ganglia nuclei provide the LHb with reward signals, either through the GPb or through different circuits. As a first step to answer this question, we electrically stimulated various parts of the basal ganglia and monitored the neural activity in the LHb in the awake monkey. First, we found that low intensity stimulations in the GPb and the internal segment of the globus pallidus (GPi) evoked a short latency (5 ms) excitatory response in LHb neurons. Second, LHb neurons were inhibited by stimulations in the ventral pallidum (VP). These results suggest that reward-related signals are transmitted to the LHb mainly through excitatory connections from the GPb and inhibitory connections from the VP. Finally, excitations or inhibitions are induced in LHb neurons from diverse but patchy regions in the striatum. These effects have considerably longer latencies, suggesting that they may be mediated by the GPb or the VP. The patchy nature of the stimulation effect raises the possibility that the striosomes are the source of reward-related signals transmitted to the LHb.
- 1 January 2013
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 7
Open AccessDiverse sources of reward value signals in the basal ganglia nuclei transmitted to the lateral habenula in the monkey
The lateral habenula (LHb) plays an important role in motivational decision making. Neurons in the primate LHb signal negative ‘reward prediction errors’ and inhibit midbrain dopamine (DA) neurons. These negative reward prediction error signals in the LHb are, at least partly, provided by a distinct group of neurons in the border region of the globus pallidus internal segment (GPb). However, it is still unclear whether other basal ganglia nuclei provide the LHb with reward signals, either through the GPb or through different circuits. As a first step to answer this question, we electrically stimulated various parts of the basal ganglia and monitored the neural activity in the LHb in the awake monkey. First, we found that low intensity stimulations in the GPb and the internal segment of the globus pallidus (GPi) evoked a short latency (5 ms) excitatory response in LHb neurons. Second, LHb neurons were inhibited by stimulations in the ventral pallidum (VP). These results suggest that reward-related signals are transmitted to the LHb mainly through excitatory connections from the GPb and inhibitory connections from the VP. Finally, excitations or inhibitions are induced in LHb neurons from diverse but patchy regions in the striatum. These effects have considerably longer latencies, suggesting that they may be mediated by the GPb or the VP. The patchy nature of the stimulation effect raises the possibility that the striosomes are the source of reward-related signals transmitted to the LHb.
- Open Access
- 1 January 2011
- Published by Frontiers Media SA in Frontiers in Behavioral Neuroscience
- Vol. 5, 8477
Dopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning
The basal ganglia (BG) are thought to play a crucial role in reinforcement learning. Central to the learning mechanism are dopamine D1 and D2 receptors located in the cortico-striatal synapses. However, it is still unclear how this dopamine-mediated synaptic plasticity is deployed and coordinated during reward-contingent behavioral changes. Here we propose a computational model of reinforcement learning that uses different thresholds of D1- and D2-mediated synaptic plasticity which are antagonized by dopamine-independent synaptic plasticity. A phasic increase in dopamine release caused by a larger-than-expected reward induces long-term potentiation (LTP) in the direct pathway, whereas a phasic decrease in dopamine release caused by a smaller-than-expected reward induces a cessation of long-term depression (LTD), leading to LTP in the indirect pathway. This learning mechanism can explain the robust behavioral adaptation observed in a location-reward-value-association task where the animal makes shorter latency saccades to rewarding locations. The changes in saccade latency become quicker as the monkey becomes more experienced. This behavior can be explained by a switching mechanism which activates the cortico-striatal circuit selectively. Our model can also simulate the effects of D1 and D2 receptor blockade, and behavioral changes in Parkinson’s disease.
- 1 January 2011
- Published by Frontiers Media SA in Frontiers in Behavioral Neuroscience
- Vol. 5, 8477
Open AccessDopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning
The basal ganglia (BG) are thought to play a crucial role in reinforcement learning. Central to the learning mechanism are dopamine D1 and D2 receptors located in the cortico-striatal synapses. However, it is still unclear how this dopamine-mediated synaptic plasticity is deployed and coordinated during reward-contingent behavioral changes. Here we propose a computational model of reinforcement learning that uses different thresholds of D1- and D2-mediated synaptic plasticity which are antagonized by dopamine-independent synaptic plasticity. A phasic increase in dopamine release caused by a larger-than-expected reward induces long-term potentiation (LTP) in the direct pathway, whereas a phasic decrease in dopamine release caused by a smaller-than-expected reward induces a cessation of long-term depression (LTD), leading to LTP in the indirect pathway. This learning mechanism can explain the robust behavioral adaptation observed in a location-reward-value-association task where the animal makes shorter latency saccades to rewarding locations. The changes in saccade latency become quicker as the monkey becomes more experienced. This behavior can be explained by a switching mechanism which activates the cortico-striatal circuit selectively. Our model can also simulate the effects of D1 and D2 receptor blockade, and behavioral changes in Parkinson’s disease.