MTMisato Tanaka

Misato Tanaka

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Misato Tanaka has a total of 36 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Cross-cue reconstruction of perceived 3D object structure from human visual cortex

    by Shuntaro C. Aoki, Reo Tsukasa, Shiyun Yang, Misato Tanaka, Eizaburo Doi, Tomohiro Nakamura, Jun-Kai Ho, Yukiyasu Kamitani

    The human brain assembles three-dimensional (3D) percepts from qualitatively different depth cues, yet the perceived 3D structure that the brain builds—a representation shared across cues—has remained difficult to measure directly. Here, we show that this cue-invariant 3D structure can be externalized as explicit 3D objects from human brain activity: fMRI responses are decoded into the latent features of a pretrained 3D point-cloud autoencoder, and a generator then maps these features back to a point cloud. A decoder trained exclusively on responses to 2D rendered objects passed three increasingly stringent tests: (i) it generalized to novel object categories; (ii) it generalized across depth cues to random dot stereograms (RDSs), which evoke 3D percepts through binocular disparity but share no pictorial shape information with the training images; and (iii) it tracked the 3D slant of contour-matched RDSs whose 2D outlines were held identical but whose disparity-defined slants varied, indicating that the reconstruction reflected depth-defined geometry rather than object category or image outline. Cross-cue generalization was strongest in higher visual areas, particularly along the dorsal stream. These results indicate that cross-cue generalization can serve as a criterion for externalizing perceived 3D structure and open a route toward reading out internal 3D representations that go beyond the momentary retinal input and could support predictions of how the world would appear under different viewpoints—a step toward externalizing the brain’s internal world model.

  • Open Access

    Decoding Shitsukan in The Brain

    by Yukiyasu Kamitani, Misato Tanaka, Tomoyasu Horikawa

  • Open Access

    Inter-individual and inter-site neural code conversion without shared stimuli

    by Haibao Wang, Jun Kai Ho, Fan L. Cheng, Shuntaro C. Aoki, Yusuke Muraki, Misato Tanaka, Jong-Yun Park, Yukiyasu Kamitani

    Inter-individual variability in fine-grained functional topographies poses challenges for scalable data analysis and modeling. Functional alignment techniques can help mitigate these individual differences but they typically require paired brain data with the same stimuli between individuals, which are often unavailable. Here we present a neural code conversion method that overcomes this constraint by optimizing conversion parameters based on the discrepancy between the stimulus contents represented by original and converted brain activity patterns. This approach, combined with hierarchical features of deep neural networks as latent content representations, achieves conversion accuracies that are comparable with methods using shared stimuli. The converted brain activity from a source subject can be accurately decoded using the target’s pre-trained decoders, producing high-quality visual image reconstructions that rival within-individual decoding, even with data across different sites and limited training samples. Our approach offers a promising framework for scalable neural data analysis and modeling and a foundation for brain-to-brain communication.


  • Top Cited Papers
    Open Access

    Spurious reconstruction from brain activity

    by Ken Shirakawa, Yoshihiro Nagano, Misato Tanaka, Shuntaro C. Aoki, Yusuke Muraki, Kei Majima, Yukiyasu Kamitani


  • Open Access

    Reconstructing visual illusory experiences from human brain activity

    by Fan L. Cheng, Tomoyasu Horikawa, Kei Majima, Misato Tanaka, Mohamed Abdelhack, Shuntaro C. Aoki, Jin Hirano, Yukiyasu Kamitani

    Visual illusions provide valuable insights into the brain’s interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here, we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding light on the brain’s internal representations of the world.


  • Open Access

    Sound reconstruction from human brain activity via a generative model with brain-like auditory features

    by Jong-Yun Park, Mitsuaki Tsukamoto, Misato Tanaka, Yukiyasu Kamitani

    The successful reconstruction of perceptual experiences from human brain activity has provided insights into the neural representations of sensory experiences. However, reconstructing arbitrary sounds has been avoided due to the complexity of temporal sequences in sounds and the limited resolution of neuroimaging modalities. To overcome these challenges, leveraging the hierarchical nature of brain auditory processing could provide a path toward reconstructing arbitrary sounds. Previous studies have indicated a hierarchical homology between the human auditory system and deep neural network (DNN) models. Furthermore, advancements in audio-generative models enable to transform compressed representations back into high-resolution sounds. In this study, we introduce a novel sound reconstruction method that combines brain decoding of auditory features with an audio-generative model. Using fMRI responses to natural sounds, we found that the hierarchical sound features of a DNN model could be better decoded than spectrotemporal features. We then reconstructed the sound using an audio transformer that disentangled compressed temporal information in the decoded DNN features. Our method shows unconstrained sounds reconstruction capturing sound perceptual contents and quality and generalizability by reconstructing sound categories not included in the training dataset. Reconstructions from different auditory regions remain similar to actual sounds, highlighting the distributed nature of auditory representations. To see whether the reconstructions mirrored actual subjective perceptual experiences, we performed an experiment involving selective auditory attention to one of overlapping sounds. The results tended to resemble the attended sound than the unattended. These findings demonstrate that our proposed model provides a means to externalize experienced auditory contents from human brain activity.

  • Open Access

    Reconstructing visual illusory experiences from human brain activity

    by Fan Cheng, Tomoyasu Horikawa, Kei Majima, Misato Tanaka, Mohamed Abdelhack, Shuntaro C. Aoki, Jin Hirano, Yukiyasu Kamitani

    Visual illusions provide significant insights into the brain’s interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding new light on the brain’s internal representations of the world.

  • Functional brain network extraction using a genetic algorithm with a kick-out method

    by Kei Harada, Misato Tanaka, Satoru Hiwa, Heiner Zille, Sanaz Mostaghim, Tomoyuki Hiroyasu

    This paper proposed the method to reduce the calculating time to reveal the functional brain network associated with a task using a genetic algorithm and functional near-infrared spectroscopy (fNIRS) data. Changes in the cerebral blood flow during a task are obtained as time series data is analyzed using fNIRS, and a correlation matrix for multiple fNIRS channels is created for each subject. The subject group is divided into two groups, and a classifier of the two groups learns the correlation matrix as a feature quantity. The correlation matrix changes as the feature quantity changes with the combinations of channels, which affects classifier accuracy. If the combination of channels with the best classifier accuracy is identified, these channels can be considered important to the creation of the functional brain network for a target task. In our study, a genetic algorithm (GA) is used for channel selection. However, learning the classifier to calculate the evaluation value and optimization by the GA requires significant time. Thus, to increase search efficiency, we propose the kick-out method to skip the evaluation value calculation for poor individuals according to a previous evaluation value. We evaluated the effectiveness of the proposed method using fNIRS data recorded during a mental rotation test. Results show that important channels that express the functional brain network were selected and that processing time was reduced significantly by the proposed method.


  • Open Access

    Crossover Method for Interactive Genetic Algorithms to Estimate Multimodal Preferences

    by Misato Tanaka, Yasunari Sasaki, Mitsunori Miki, Tomoyuki Hiroyasu

    We apply an interactive genetic algorithm (iGA) to generate product recommendations. iGAs search for a single optimum point based on a user’s Kansei through the interaction between the user and machine. However, especially in the domain of product recommendations, there may be numerous optimum points. Therefore, the purpose of this study is to develop a new iGA crossover method that concurrently searches for multiple optimum points for multiple user preferences. The proposed method estimates the locations of the optimum area by a clustering method and then searches for the maximum values of the area by a probabilistic model. To confirm the effectiveness of this method, two experiments were performed. In the first experiment, a pseudouser operated an experiment system that implemented the proposed and conventional methods and the solutions obtained were evaluated using a set of pseudomultiple preferences. With this experiment, we proved that when there are multiple preferences, the proposed method searches faster and more diversely than the conventional one. The second experiment was a subjective experiment. This experiment showed that the proposed method was able to search concurrently for more preferences when subjects had multiple preferences.


  • Construction of an Interactive System Aims to Extract Expert Knowledge about the Condition Cultured Corneal Endothelial Cells

    by Tomoyuki Hiroyasu, Kiyofumi Uehori, Utako Yamamoto, Misato Tanaka

    We aim to construct an expert system for diagnosing the health of corneal endothelial cells. To construct the proposed system, we first constructed a system that confirms whether experts use the same criteria to diagnose the condition of cells. In the constructed system, an expert interacts with a computer that generates images of cells by simulation. These images describe cells that are in the best condition, according to expert diagnosis. By comparing the results from multiple experts, we can elucidate whether experts use the same criterion for diagnosis. The proposed system is composed of an interactive genetic algorithm (IGA) and involves the simulation of cells. We confirmed the system operated normally through operational experiments. In another experiment, conducted with no experts, we confirmed that this system could generate images demonstrating a predetermined feature value.