HMHiroshi Makino

Hiroshi Makino

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Hiroshi Makino has a total of 20 co-authors. Here are the top co-authors by number of shared publications:

  • Xin Wei Chia

    Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

    3 shared publications
  • Ahmad Suhaimi

    Lee Kong Chian School of Medicine, Nanyang Technological University, 11 Mandalay Road, Singapore 308232, Singapore

    2 shared publications
  • Amos W. H. Lim

    Actxa Pte Ltd, Singapore, Singapore

    1 shared publication
  • An Na Kim

    Neurobiology Section, Center for Neural Circuits and Behavior, Department of Neurosciences, University of California, San Diego, La Jolla, CA 92093, USA

    1 shared publication
  • Chi Ren

    Neurobiology Section, Center for Neural Circuits and Behavior, Department of Neurosciences, University of California, San Diego, La Jolla, CA 92093, USA

    1 shared publication
  • Chunyue Li

    Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

    1 shared publication

Latest Publications

  • Open Access

    Vulnerability of short-term memory in a mouse model of Alzheimer’s disease

    by Chunyue Li, Xin Wei Chia, Guozhong Xu, Lee Fang Ang, Hiroshi Makino

    Interference from distracting stimuli renders short-term memory vulnerable. While behavioral evidence suggests short-term memory deficits in Alzheimer’s disease (AD), the underlying neural mechanisms remain poorly understood. Using a mouse model of AD (APP-KI), we identified increased susceptibility of short-term memory to sensory perturbations. Simultaneous two-photon calcium imaging across eight cortical regions during a delayed-response task showed that distractors disrupted neural selectivity at both single-neuron and population levels in APP-KI mice. Recurrent neural network models replicating the neural activity of APP-KI mice exhibited decreased stability, consistent with reduced functional connectivity across the dorsal cortex. Furthermore, analyses of multi-regional corticocortical communication revealed reduced spatiotemporal degeneracy in activity transmission within the dorsal cortex of APP-KI mice, which could account for their attenuated robustness during sensorimotor transformations. Collectively, these findings identify reduced functional connectivity and impaired spatiotemporal degeneracy as central mechanisms of short-term memory deficits in the APP-KI mouse model of AD.

  • Open Access

    Distributed representations of temporally accumulated reward prediction errors in the mouse cortex

    by Hiroshi Makino, Ahmad Suhaimi

    Reward prediction errors (RPEs) quantify the difference between expected and actual rewards, serving to refine future actions. Although reinforcement learning (RL) provides ample theoretical evidence suggesting that the long-term accumulation of these error signals improves learning efficiency, it remains unclear whether the brain uses similar mechanisms. To explore this, we constructed RL-based theoretical models and used multiregional two-photon calcium imaging in the mouse dorsal cortex. We identified a population of neurons whose activity was modulated by varying degrees of RPE accumulation. Consequently, RPE-encoding neurons were sequentially activated within each trial, forming a distributed assembly. RPE representations in mice aligned with theoretical predictions of RL, emerging during learning and being subject to manipulations of the reward function. Interareal comparisons revealed a region-specific code, with higher-order cortical regions exhibiting long-term encoding of RPE accumulation. These results present an additional layer of complexity in cortical RPE computation, potentially augmenting learning efficiency in animals.


  • Open Access

    Emergence of cortical network motifs for short-term memory during learning

    by Xin Wei Chia, Jian Kwang Tan, Lee Fang Ang, Tsukasa Kamigaki, Hiroshi Makino

    Learning of adaptive behaviors requires the refinement of coordinated activity across multiple brain regions. However, how neural communications develop during learning remains poorly understood. Here, using two-photon calcium imaging, we simultaneously recorded the activity of layer 2/3 excitatory neurons in eight regions of the mouse dorsal cortex during learning of a delayed-response task. Across learning, while global functional connectivity became sparser, there emerged a subnetwork comprising of neurons in the anterior lateral motor cortex (ALM) and posterior parietal cortex (PPC). Neurons in this subnetwork shared a similar choice code during action preparation and formed recurrent functional connectivity across learning. Suppression of PPC activity disrupted choice selectivity in ALM and impaired task performance. Recurrent neural networks reconstructed from ALM activity revealed that PPC-ALM interactions rendered choice-related attractor dynamics more stable. Thus, learning constructs cortical network motifs by recruiting specific inter-areal communication channels to promote efficient and robust sensorimotor transformation.


  • Open Access

    Arithmetic value representation for hierarchical behavior composition

    by Hiroshi Makino

    The ability to compose new skills from a preacquired behavior repertoire is a hallmark of biological intelligence. Although artificial agents extract reusable skills from past experience and recombine them in a hierarchical manner, whether the brain similarly composes a novel behavior is largely unknown. In the present study, I show that deep reinforcement learning agents learn to solve a novel composite task by additively combining representations of prelearned action values of constituent subtasks. Learning efficacy in the composite task was further augmented by the introduction of stochasticity in behavior during pretraining. These theoretical predictions were empirically tested in mice, where subtask pretraining enhanced learning of the composite task. Cortex-wide, two-photon calcium imaging revealed analogous neural representations of combined action values, with improved learning when the behavior variability was amplified. Together, these results suggest that the brain composes a novel behavior with a simple arithmetic operation of preacquired action-value representations with stochastic policies.


  • Open Access

    Representation learning in the artificial and biological neural networks underlying sensorimotor integration

    by Ahmad Suhaimi, Amos W. H. Lim, Xin Wei Chia, Chunyue Li, Hiroshi Makino

    The integration of deep learning and theories of reinforcement learning (RL) is a promising avenue to explore novel hypotheses on reward-based learning and decision-making in humans and other animals. Here, we trained deep RL agents and mice in the same sensorimotor task with high-dimensional state and action space and studied representation learning in their respective neural networks. Evaluation of thousands of neural network models with extensive hyperparameter search revealed that learning-dependent enrichment of state-value and policy representations of the task-performance-optimized deep RL agent closely resembled neural activity of the posterior parietal cortex (PPC). These representations were critical for the task performance in both systems. PPC neurons also exhibited representations of the internally defined subgoal, a feature of deep RL algorithms postulated to improve sample efficiency. Such striking resemblance between the artificial and biological networks and their functional convergence in sensorimotor integration offers new opportunities to better understand respective intelligent systems.


  • Top Cited Papers

    Transformation of Cortex-wide Emergent Properties during Motor Learning

    by Hiroshi Makino, Chi Ren, Haixin Liu, An Na Kim, Neehar Kondapaneni, Xin Liu, Duygu Kuzum, Takaki Komiyama