Kosuke Miyoshi
Research Subjects
Kosuke Miyoshi has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Masaki Takeda
Kochi University of Technology
3 shared publications - Kiyoshi Nakahara
Kochi University of Technology
2 shared publications - Koji Jimura
Department of Informatics, Gunma University , 4-2 Aramaki-machi, Maebashi, 371-8510 , Japan
2 shared publications - Cui Lang
Graduate School of Engineering, Kochi University of Technology, Kami, Kochi 782-8502, Japan
1 shared publication Daisuke Shimane
Research Center for Brain Communication, Kochi University of Technology, Kami, Kochi 782-8502, Japan
1 shared publication- Daisuke Shimane
Kochi University of Technology
1 shared publication
Latest Publications
- Open Access
Deep-learning-based fMRI decoding of real-world size for hand-held objects
Real-world object size is a fundamental dimension of visual cognition, supporting effective interaction with the environment and object manipulation. However, neural mechanisms encoding size have largely been inferred from extreme size comparisons, leaving the neural representation of subtle size differences within a manipulable, "hand-scale" range poorly understood. Here, we applied a three-dimensional deep neural network (3D DNN) to decode real-world size from whole-brain fMRI data (N = 50) using objects that all fall within a graspable range. The 3D DNN successfully decoded subtle size differences, achieving predictive accuracies comparable to multivariate pattern analysis. Crucially, Guided Gradient-weighted Class Activation Mapping (Guided Grad-CAM) revealed that discriminative size information was not confined to the ventral occipito-temporal cortex but extended to a distributed network. Notably, these regions spatially overlap with the specific brain areas implicated in size-perception distortions following brain damage. Our findings suggest that the brain represents subtle variations in object size through a non-linear, distributed network that transcends the traditional visual hierarchy. Specifically, this system likely orchestrates the integration of visual properties with semantic scaling and the multimodal convergence of vision, space, and memory.
Open AccessDeep-learning-based fMRI decoding of real-world size for hand-held objects
Real-world object size is a fundamental dimension of visual cognition, supporting effective interaction with the environment and object manipulation. However, neural mechanisms encoding size have largely been inferred from extreme size comparisons, leaving the neural representation of subtle size differences within a manipulable, "hand-scale" range poorly understood. Here, we applied a three-dimensional deep neural network (3D DNN) to decode real-world size from whole-brain fMRI data (N = 50) using objects that all fall within a graspable range. The 3D DNN successfully decoded subtle size differences, achieving predictive accuracies comparable to multivariate pattern analysis. Crucially, Guided Gradient-weighted Class Activation Mapping (Guided Grad-CAM) revealed that discriminative size information was not confined to the ventral occipito-temporal cortex but extended to a distributed network. Notably, these regions spatially overlap with the specific brain areas implicated in size-perception distortions following brain damage. Our findings suggest that the brain represents subtle variations in object size through a non-linear, distributed network that transcends the traditional visual hierarchy. Specifically, this system likely orchestrates the integration of visual properties with semantic scaling and the multimodal convergence of vision, space, and memory.
- Open Access
- 10 May 2023
- Published by Elsevier in NeuroImage
- Vol. 275, 120164
Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans
- 10 May 2023
- Published by Elsevier in NeuroImage
- Vol. 275, 120164
Open AccessMultimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans
- Open Access
Multimodal deep neural decoding of visual object representation in humans
Perception and categorization of objects in a visual scene are essential to grasp the surrounding situation. However, it is unclear how neural activities in spatially distributed brain regions, especially in terms of temporal dynamics, represent visual objects. To address this issue, we explored the spatial and temporal organization of visual object representations using concurrent functional magnetic resonance imaging (fMRI) and electroencephalography (EEG), combined with neural decoding using deep neural networks (DNNs). Visualization of the fMRI DNN revealed that visual categorization (faces or non-face objects) occurred in brain-wide cortical regions, including the ventral temporal cortex. Interestingly, the EEG DNN valued the earlier phase of neural responses for categorization and the later phase of neural responses for sub-categorization. Combination of the two DNNs improved the classification performance for both categorization and sub-categorization. These deep learning-based results demonstrate a categorization principle in which visual objects are represented in a spatially organized and coarse-to-fine manner.
Open AccessMultimodal deep neural decoding of visual object representation in humans
Perception and categorization of objects in a visual scene are essential to grasp the surrounding situation. However, it is unclear how neural activities in spatially distributed brain regions, especially in terms of temporal dynamics, represent visual objects. To address this issue, we explored the spatial and temporal organization of visual object representations using concurrent functional magnetic resonance imaging (fMRI) and electroencephalography (EEG), combined with neural decoding using deep neural networks (DNNs). Visualization of the fMRI DNN revealed that visual categorization (faces or non-face objects) occurred in brain-wide cortical regions, including the ventral temporal cortex. Interestingly, the EEG DNN valued the earlier phase of neural responses for categorization and the later phase of neural responses for sub-categorization. Combination of the two DNNs improved the classification performance for both categorization and sub-categorization. These deep learning-based results demonstrate a categorization principle in which visual objects are represented in a spatially organized and coarse-to-fine manner.