Sotaro Shimada
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Sotaro Shimada has a total of 39 co-authors. Here are the top co-authors by number of shared publications:
Yuki Tsuji
Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, 1-1-1 Higashi -Mita, Tama-ku, Kawasaki-shi, Kanagawa 214-8571, Japan
3 shared publications- Katsuki Higo
Organization for the Strategic Coordination of Research and Intellectual Properties, Meiji University, Kawasaki, Japan
2 shared publications - Alexandre Pitti
Affiliation ETIS Laboratory, CNRS UMR 8051, University of Cergy-Pontoise, ENSEA, Paris-Seine, Cergy-Pontoise, France
1 shared publication - Berend Te Linde
Graduate School of Media Design, Keio University, Yokohama, Japan
1 shared publication - Charalampos Krekoukiotis
Graduate School of Media Design, Keio University, Yokohama, Japan
1 shared publication Fuyu Ueno
Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, Kawasaki, Japan
1 shared publication
Latest Publications
- Open Access
- 25 July 2026
- Published by Elsevier in New Ideas in Psychology
- Vol. 83
Narrative embodiment: A conceptual framework linking the narrative self and the embodied self
- 25 July 2026
- Published by Elsevier in New Ideas in Psychology
- Vol. 83
Open AccessNarrative embodiment: A conceptual framework linking the narrative self and the embodied self
- Open Access
- 28 April 2026
- Published by Springer Nature in Phenomenology and the Cognitive Sciences
- p. 1-20
Embodying the narrative self, narrating the embodied self
This paper explores the mutually shaping relationship between embodiment and narrativity in the formation of selfhood. Although previous research has tended to treat the embodied and narrative self as interacting, yet distinct, layers, we argue for a more integrated account in which each is grounded in and shaped by the other, characterizing them as mutually shaping. Drawing on phenomenological concepts such as body schema and habituality, we first demonstrate how bodily dispositions support the temporal continuity and expressive unfolding of the narrative self, including both the “narrated I” and the “narrating I.” In this view, narrative identity emerges from embodied engagement with the world rather than from purely cognitive processes. In the second half of the paper, we reverse the direction of influence, examining how identification with narrative figures can reshape body image and bodily orientation through mechanisms such as the Proteus effect. However, we also show that such narrative-induced transformations are constrained by sociocultural norms and master narratives that delimit which bodies and identities are deemed intelligible or aspirational. Through this analysis, we propose an account of selfhood as fundamentally embodied, narratively structured, and constrained by systems of power, visibility, and cultural representation.
- 28 April 2026
- Published by Springer Nature in Phenomenology and the Cognitive Sciences
- p. 1-20
Open AccessEmbodying the narrative self, narrating the embodied self
This paper explores the mutually shaping relationship between embodiment and narrativity in the formation of selfhood. Although previous research has tended to treat the embodied and narrative self as interacting, yet distinct, layers, we argue for a more integrated account in which each is grounded in and shaped by the other, characterizing them as mutually shaping. Drawing on phenomenological concepts such as body schema and habituality, we first demonstrate how bodily dispositions support the temporal continuity and expressive unfolding of the narrative self, including both the “narrated I” and the “narrating I.” In this view, narrative identity emerges from embodied engagement with the world rather than from purely cognitive processes. In the second half of the paper, we reverse the direction of influence, examining how identification with narrative figures can reshape body image and bodily orientation through mechanisms such as the Proteus effect. However, we also show that such narrative-induced transformations are constrained by sociocultural norms and master narratives that delimit which bodies and identities are deemed intelligible or aspirational. Through this analysis, we propose an account of selfhood as fundamentally embodied, narratively structured, and constrained by systems of power, visibility, and cultural representation.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Animacy and the Eye of the Beholder: A Mixed-Methods Study on Cognitive Animacy with a Kinetic Origami Surface
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Open AccessAnimacy and the Eye of the Beholder: A Mixed-Methods Study on Cognitive Animacy with a Kinetic Origami Surface
- Open Access
- 17 March 2026
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 17, 1775907
Positive narrativity enhances sense of agency toward a VR avatar
The full-body illusion (FBI) refers to the experience of perceiving a virtual avatar as one’s own body. In virtual reality (VR) environments, inducing the FBI has been shown to modulate users’ bodily experiences and behavior. Previous studies have demonstrated that embodying avatars with specific characteristics can influence users’ actions, largely through the activation of implicit stereotypes. However, few studies have explicitly manipulated users’ impressions of an avatar by introducing narrative context. The present study investigated how avatar narrativity, induced through contextual narratives, affects the FBI. Healthy participants embodied a powerful artificial lifeform avatar in VR after listening to either a positive narrative, in which the avatar used its abilities to protect others, or a negative narrative, in which it misused its power. Participants’ impressions of the avatar and indices of bodily self-consciousness were subsequently assessed. The results showed that positive narratives significantly enhanced the sense of agency (SoA), and that SoA was positively correlated with participants’ perceived personal familiarity with the avatar. These findings suggest that the avatar narrativity can modulate embodiment in VR.
- 17 March 2026
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 17, 1775907
Open AccessPositive narrativity enhances sense of agency toward a VR avatar
The full-body illusion (FBI) refers to the experience of perceiving a virtual avatar as one’s own body. In virtual reality (VR) environments, inducing the FBI has been shown to modulate users’ bodily experiences and behavior. Previous studies have demonstrated that embodying avatars with specific characteristics can influence users’ actions, largely through the activation of implicit stereotypes. However, few studies have explicitly manipulated users’ impressions of an avatar by introducing narrative context. The present study investigated how avatar narrativity, induced through contextual narratives, affects the FBI. Healthy participants embodied a powerful artificial lifeform avatar in VR after listening to either a positive narrative, in which the avatar used its abilities to protect others, or a negative narrative, in which it misused its power. Participants’ impressions of the avatar and indices of bodily self-consciousness were subsequently assessed. The results showed that positive narratives significantly enhanced the sense of agency (SoA), and that SoA was positively correlated with participants’ perceived personal familiarity with the avatar. These findings suggest that the avatar narrativity can modulate embodiment in VR.
- Open Access
Avatar facial expressions enhance social presence and inter-brain synchronization in virtual reality
Virtual reality (VR) has become a prominent medium for computer-mediated social interaction, yet the psychological and neural mechanisms underpinning avatar-mediated communication remain insufficiently understood. This study investigated how dynamically modulated avatar facial expressions shape interpersonal interaction in VR. Pairs of participants engaged in a collaborative creativity task while interacting via avatars whose facial expressions were either amplified, natural, or expressionless. We collected subjective measures of body ownership, social presence, and interpersonal attraction, while simultaneously recording neural activity using functional near-infrared-spectroscopy-based hyperscanning to assess inter-brain synchrony (IBS). Avatars displaying facial expressions, particularly amplified ones, significantly enhanced body ownership, social presence, and interpersonal attraction compared to expressionless avatars. At the neural level, visible avatar facial expressions were associated with IBS in the right temporo-parietal junction (TPJ) and the dorsolateral prefrontal cortex (dlPFC), regions that are commonly implicated in social-cognitive processes such as mentalizing and executive control. Although task performance did not differ across conditions, social presence was positively correlated with creative performance, suggesting that psychological connectedness supports collaborative creativity. Together, these findings indicate that avatar facial expressivity functions as a critical nonverbal social cue that facilitates affective and cognitive alignment between interaction partners. By linking subjective experience with inter-brain neural dynamics, this study provides empirical guidance for the design of virtual environments that promote social engagement and effective collaboration.
Open AccessAvatar facial expressions enhance social presence and inter-brain synchronization in virtual reality
Virtual reality (VR) has become a prominent medium for computer-mediated social interaction, yet the psychological and neural mechanisms underpinning avatar-mediated communication remain insufficiently understood. This study investigated how dynamically modulated avatar facial expressions shape interpersonal interaction in VR. Pairs of participants engaged in a collaborative creativity task while interacting via avatars whose facial expressions were either amplified, natural, or expressionless. We collected subjective measures of body ownership, social presence, and interpersonal attraction, while simultaneously recording neural activity using functional near-infrared-spectroscopy-based hyperscanning to assess inter-brain synchrony (IBS). Avatars displaying facial expressions, particularly amplified ones, significantly enhanced body ownership, social presence, and interpersonal attraction compared to expressionless avatars. At the neural level, visible avatar facial expressions were associated with IBS in the right temporo-parietal junction (TPJ) and the dorsolateral prefrontal cortex (dlPFC), regions that are commonly implicated in social-cognitive processes such as mentalizing and executive control. Although task performance did not differ across conditions, social presence was positively correlated with creative performance, suggesting that psychological connectedness supports collaborative creativity. Together, these findings indicate that avatar facial expressivity functions as a critical nonverbal social cue that facilitates affective and cognitive alignment between interaction partners. By linking subjective experience with inter-brain neural dynamics, this study provides empirical guidance for the design of virtual environments that promote social engagement and effective collaboration.
- Open Access
- 12 September 2025
- Published by Society for Neuroscience in eneuro
- Vol. 12 (9)
Distinct Roles of the Premotor and Occipitotemporal Cortices in the Full-Body Illusion
The sense of body ownership, a core aspect of self-recognition, has been studied using illusions such as the full-body illusion. Although the premotor cortex is considered central to body ownership in first-person full–body illusions, the occipitotemporal cortex—including the temporoparietal junction (TPJ) and the extrastriate body area (EBA)—also plays a critical role in third-person full–body illusions. However, their distinct contributions to the full-body illusion remain unclear, partly due to the challenges of applying neuroimaging in such experiments. This study employed functional near-infrared spectroscopy to investigate brain activity during a third-person full–body illusion in virtual reality. Eighteen healthy human adult males participated in the study. The experiment consisted of two sessions. In Session 1, participants observed an avatar's back receiving either synchronous or asynchronous visual–tactile stimulation. In Session 2, visual stimuli alone were presented to participants after they experienced the full-body illusion to induce visuotactile discrepancies. In the synchronous condition of Session 1, we found significant deactivation in the superior and middle temporal gyri (partially including the TPJ), followed by higher activity than in the asynchronous condition in the left middle occipital gyrus (likely EBA). The left premotor cortex also showed significant activation (uncorrected), although this did not survive multiple-comparison adjustment. In Session 2, the visuotactile discrepancy induced significant left premotor activation only in the synchronous condition (FDR-corrected). These findings suggest that the occipitotemporal cortex supports receptivity to third-person full–body illusions, whereas the premotor cortex contributes to maintaining illusory body ownership by reconciling multisensory conflicts.
- 12 September 2025
- Published by Society for Neuroscience in eneuro
- Vol. 12 (9)
Open AccessDistinct Roles of the Premotor and Occipitotemporal Cortices in the Full-Body Illusion
The sense of body ownership, a core aspect of self-recognition, has been studied using illusions such as the full-body illusion. Although the premotor cortex is considered central to body ownership in first-person full–body illusions, the occipitotemporal cortex—including the temporoparietal junction (TPJ) and the extrastriate body area (EBA)—also plays a critical role in third-person full–body illusions. However, their distinct contributions to the full-body illusion remain unclear, partly due to the challenges of applying neuroimaging in such experiments. This study employed functional near-infrared spectroscopy to investigate brain activity during a third-person full–body illusion in virtual reality. Eighteen healthy human adult males participated in the study. The experiment consisted of two sessions. In Session 1, participants observed an avatar's back receiving either synchronous or asynchronous visual–tactile stimulation. In Session 2, visual stimuli alone were presented to participants after they experienced the full-body illusion to induce visuotactile discrepancies. In the synchronous condition of Session 1, we found significant deactivation in the superior and middle temporal gyri (partially including the TPJ), followed by higher activity than in the asynchronous condition in the left middle occipital gyrus (likely EBA). The left premotor cortex also showed significant activation (uncorrected), although this did not survive multiple-comparison adjustment. In Session 2, the visuotactile discrepancy induced significant left premotor activation only in the synchronous condition (FDR-corrected). These findings suggest that the occipitotemporal cortex supports receptivity to third-person full–body illusions, whereas the premotor cortex contributes to maintaining illusory body ownership by reconciling multisensory conflicts.
- Open Access
- 8 November 2024
- Published by MDPI AG in Brain Sciences
- Vol. 14 (11) , 1130
Neural Mechanism of Musical Pleasure Induced by Prediction Errors: An EEG Study
Background/Objectives: Musical pleasure is considered to be induced by prediction errors (surprise), as suggested in neuroimaging studies. However, the role of temporal changes in musical features in reward processing remains unclear. Utilizing the Information Dynamics of Music (IDyOM) model, a statistical model that calculates musical surprise based on prediction errors in melody and harmony, we investigated whether brain activities associated with musical pleasure, particularly in the θ, β, and γ bands, are induced by prediction errors, similar to those observed during monetary rewards. Methods: We used the IDyOM model to calculate the information content (IC) of surprise for melody and harmony in 70 musical pieces across six genres; eight pieces with varying IC values were selected. Electroencephalographic data were recorded during listening to the pieces, continuously evaluating the participants’ subjective pleasure on a 1–4 scale. Time–frequency analysis of electroencephalographic data was conducted, followed by general linear model analysis to fit the power-value time course in each frequency band to the time courses of subjective pleasure and IC for melody and harmony. Results: Significant positive fits were observed in the β and γ bands in the frontal region with both subjective pleasure and IC for melody and harmony. No significant fit was observed in the θ band. Both subjective pleasure and IC are associated with increased β and γ band power in the frontal regions. Conclusions: β and γ oscillatory activities in the frontal regions are strongly associated with musical rewards induced by prediction errors, similar to brain activity observed during monetary rewards.
- 8 November 2024
- Published by MDPI AG in Brain Sciences
- Vol. 14 (11) , 1130
Open AccessNeural Mechanism of Musical Pleasure Induced by Prediction Errors: An EEG Study
Background/Objectives: Musical pleasure is considered to be induced by prediction errors (surprise), as suggested in neuroimaging studies. However, the role of temporal changes in musical features in reward processing remains unclear. Utilizing the Information Dynamics of Music (IDyOM) model, a statistical model that calculates musical surprise based on prediction errors in melody and harmony, we investigated whether brain activities associated with musical pleasure, particularly in the θ, β, and γ bands, are induced by prediction errors, similar to those observed during monetary rewards. Methods: We used the IDyOM model to calculate the information content (IC) of surprise for melody and harmony in 70 musical pieces across six genres; eight pieces with varying IC values were selected. Electroencephalographic data were recorded during listening to the pieces, continuously evaluating the participants’ subjective pleasure on a 1–4 scale. Time–frequency analysis of electroencephalographic data was conducted, followed by general linear model analysis to fit the power-value time course in each frequency band to the time courses of subjective pleasure and IC for melody and harmony. Results: Significant positive fits were observed in the β and γ bands in the frontal region with both subjective pleasure and IC for melody and harmony. No significant fit was observed in the θ band. Both subjective pleasure and IC are associated with increased β and γ band power in the frontal regions. Conclusions: β and γ oscillatory activities in the frontal regions are strongly associated with musical rewards induced by prediction errors, similar to brain activity observed during monetary rewards.
- Open Access
- 21 August 2023
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 17, 1225377
Inter-subject correlations of EEG reflect subjective arousal and acoustic features of music
Background: Research on music-induced emotion and brain activity is constantly expanding. Although studies using inter-subject correlation (ISC), a collectively shared brain activity analysis method, have been conducted, whether ISC during music listening represents the music preferences of a large population remains uncertain; additionally, it remains unclear which factors influence ISC during music listening. Therefore, here, we aimed to investigate whether the ISCs of electroencephalography (EEG) during music listening represent a preference for music reflecting engagement or interest of a large population in music.Methods: First, we selected 21 pieces of music from the Billboard Japan Hot 100 chart of 2017, which served as an indicator of preference reflecting the engagement and interest of a large population. To ensure even representation, we chose one piece for every fifth song on the chart, spanning from highly popular music to less popular ones. Next, we recorded EEG signals while the subjects listened to the selected music, and they were asked to evaluate four aspects (preference, enjoyment, frequency of listening, and arousal) for each song. Subsequently, we conducted ISC analysis by utilizing the first three principal components of EEG, which were highly correlated across subjects and extracted through correlated component analysis (CorrCA). We then explored whether music with high preferences that reflected the engagement and interest of large population had high ISC values. Additionally, we employed cluster analysis on all 21 pieces of music, utilizing the first three principal components of EEG, to investigate the impact of emotions and musical characteristics on EEG ISC during music listening.Results: A significant distinction was noted between the mean ISC values of the 10 higher-ranked pieces of music compared to the 10 lower-ranked pieces of music [t(542) = −1.97, p = 0.0025]. This finding suggests that ISC values may correspond preferences reflecting engagement or interest of a large population. Furthermore, we found that significant variations were observed in the first three principal component values among the three clusters identified through cluster analysis, along with significant differences in arousal levels. Moreover, the characteristics of the music (tonality and tempo) differed among the three clusters. This indicates that the principal components, which exhibit high correlation among subjects and were employed in calculating ISC values, represent both subjects’ arousal levels and specific characteristics of the music.Conclusion: Subjects’ arousal values during music listening and music characteristics (tonality and tempo) affect ISC values, which represent the interest of a large population in music.
- 21 August 2023
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 17, 1225377
Open AccessInter-subject correlations of EEG reflect subjective arousal and acoustic features of music
Background: Research on music-induced emotion and brain activity is constantly expanding. Although studies using inter-subject correlation (ISC), a collectively shared brain activity analysis method, have been conducted, whether ISC during music listening represents the music preferences of a large population remains uncertain; additionally, it remains unclear which factors influence ISC during music listening. Therefore, here, we aimed to investigate whether the ISCs of electroencephalography (EEG) during music listening represent a preference for music reflecting engagement or interest of a large population in music.Methods: First, we selected 21 pieces of music from the Billboard Japan Hot 100 chart of 2017, which served as an indicator of preference reflecting the engagement and interest of a large population. To ensure even representation, we chose one piece for every fifth song on the chart, spanning from highly popular music to less popular ones. Next, we recorded EEG signals while the subjects listened to the selected music, and they were asked to evaluate four aspects (preference, enjoyment, frequency of listening, and arousal) for each song. Subsequently, we conducted ISC analysis by utilizing the first three principal components of EEG, which were highly correlated across subjects and extracted through correlated component analysis (CorrCA). We then explored whether music with high preferences that reflected the engagement and interest of large population had high ISC values. Additionally, we employed cluster analysis on all 21 pieces of music, utilizing the first three principal components of EEG, to investigate the impact of emotions and musical characteristics on EEG ISC during music listening.Results: A significant distinction was noted between the mean ISC values of the 10 higher-ranked pieces of music compared to the 10 lower-ranked pieces of music [t(542) = −1.97, p = 0.0025]. This finding suggests that ISC values may correspond preferences reflecting engagement or interest of a large population. Furthermore, we found that significant variations were observed in the first three principal component values among the three clusters identified through cluster analysis, along with significant differences in arousal levels. Moreover, the characteristics of the music (tonality and tempo) differed among the three clusters. This indicates that the principal components, which exhibit high correlation among subjects and were employed in calculating ISC values, represent both subjects’ arousal levels and specific characteristics of the music.Conclusion: Subjects’ arousal values during music listening and music characteristics (tonality and tempo) affect ISC values, which represent the interest of a large population in music.
- Open Access
- 20 April 2023
- Published by MDPI AG in Virtual Worlds
- Vol. 2 (2) , 129-143
Inter-Subject EEG Synchronization during a Cooperative Motor Task in a Shared Mixed-Reality Environment
Mixed-reality (MR) environments, in which virtual objects are overlaid on the real environment and shared with peers by wearing a transparent optical head-mounted display, are considered to be well suited for collaborative work. However, no studies have been conducted to provide neuroscientific evidence of its effectiveness. In contrast, inter-brain synchronization has been repeatedly observed in cooperative tasks and can be used as an index of the quality of cooperation. In this study, we used electroencephalography (EEG) to simultaneously measure the brain activity of pairs of participants, a technique known as hyperscanning, during a cooperative motor task to investigate whether inter-brain synchronization would be also observed in a shared MR environment. The participants were presented with virtual building blocks to grasp and build up an object cooperatively with a partner or individually. We found that inter-brain synchronization in the cooperative condition was stronger than that in the individual condition (F(1, 15) = 4.70, p < 0.05). In addition, there was a significant correlation between task performance and inter-brain synchronization in the cooperative condition (rs = 0.523, p < 0.05). Therefore, the shared MR environment was sufficiently effective to evoke inter-brain synchronization, which reflects the quality of cooperation. This study offers a promising neuroscientific method to objectively measure the effectiveness of MR technology.
- 20 April 2023
- Published by MDPI AG in Virtual Worlds
- Vol. 2 (2) , 129-143
Open AccessInter-Subject EEG Synchronization during a Cooperative Motor Task in a Shared Mixed-Reality Environment
Mixed-reality (MR) environments, in which virtual objects are overlaid on the real environment and shared with peers by wearing a transparent optical head-mounted display, are considered to be well suited for collaborative work. However, no studies have been conducted to provide neuroscientific evidence of its effectiveness. In contrast, inter-brain synchronization has been repeatedly observed in cooperative tasks and can be used as an index of the quality of cooperation. In this study, we used electroencephalography (EEG) to simultaneously measure the brain activity of pairs of participants, a technique known as hyperscanning, during a cooperative motor task to investigate whether inter-brain synchronization would be also observed in a shared MR environment. The participants were presented with virtual building blocks to grasp and build up an object cooperatively with a partner or individually. We found that inter-brain synchronization in the cooperative condition was stronger than that in the individual condition (F(1, 15) = 4.70, p < 0.05). In addition, there was a significant correlation between task performance and inter-brain synchronization in the cooperative condition (rs = 0.523, p < 0.05). Therefore, the shared MR environment was sufficiently effective to evoke inter-brain synchronization, which reflects the quality of cooperation. This study offers a promising neuroscientific method to objectively measure the effectiveness of MR technology.
- Open Access
Multisensory and Sensorimotor Integration in the Embodied Self: Relationship between Self-Body Recognition and the Mirror Neuron System
The embodied self is rooted in the self-body in the “here and now”. The senses of self-ownership and self-agency have been proposed as the basis of the sense of embodied self, and many experimental studies have been conducted on this subject. This review summarizes the experimental research on the embodied self that has been conducted over the past 20 years, mainly from the perspective of multisensory integration and sensorimotor integration regarding the self-body. Furthermore, the phenomenon of back projection, in which changes in an external object (e.g., a rubber hand) with which one has a sense of ownership have an inverse influence on the sensation and movement of one’s own body, is discussed. This postulates that the self-body illusion is not merely an illusion caused by multisensory and/or sensorimotor integration, but is the incorporation of an external object into the self-body representation in the brain. As an extension of this fact, we will also review research on the mirror neuron system, which is considered to be the neural basis of recognition of others, and discuss how the neural basis of self-body recognition and the mirror neuron system can be regarded as essentially the same.
Open AccessMultisensory and Sensorimotor Integration in the Embodied Self: Relationship between Self-Body Recognition and the Mirror Neuron System
The embodied self is rooted in the self-body in the “here and now”. The senses of self-ownership and self-agency have been proposed as the basis of the sense of embodied self, and many experimental studies have been conducted on this subject. This review summarizes the experimental research on the embodied self that has been conducted over the past 20 years, mainly from the perspective of multisensory integration and sensorimotor integration regarding the self-body. Furthermore, the phenomenon of back projection, in which changes in an external object (e.g., a rubber hand) with which one has a sense of ownership have an inverse influence on the sensation and movement of one’s own body, is discussed. This postulates that the self-body illusion is not merely an illusion caused by multisensory and/or sensorimotor integration, but is the incorporation of an external object into the self-body representation in the brain. As an extension of this fact, we will also review research on the mirror neuron system, which is considered to be the neural basis of recognition of others, and discuss how the neural basis of self-body recognition and the mirror neuron system can be regarded as essentially the same.