Haemy Lee Masson
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Haemy Lee Masson has a total of 36 co-authors. Here are the top co-authors by number of shared publications:
- Hans Op de Beeck
KU Leuven
12 shared publications - Bart Boets
Center for Developmental Psychiatry, Department of Neurosciences, KU Leuven, 3000 Leuven, Belgium
6 shared publications - Leyla Isik
Johns Hopkins University
6 shared publications - Ineke Pillet
KU Leuven
5 shared publications Steffie Amelynck
Center for Developmental Psychiatry, KU Leuven, 3000 Leuven, Belgium
4 shared publications- Christian Wallraven
Affiliations Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea, Department of Artificial Intelligence, Korea University, Seoul, South Korea
3 shared publications
Latest Publications
- Open Access
- 30 December 2025
- Published by SAGE Publications in Autism
- Vol. 30 (3) , 626-641
Autistic adults prefer social touch less but engage just as much: The impact of social context, relationship type, sensory responsivity, and psychological factors
Autistic people face touch-related challenges, yet the factors influencing these difficulties are not well understood. We developed a novel instrument to capture social touch experiences of autistic adults, along with both social and individual factors that influence them. Using a body-painting task and questionnaires, we demonstrated that the perception of touch interactions varies based on social contexts and neurotypes. Autistic adults, on average, prefer touch less, but the type of relationship influences the perceived comfort and meaningfulness of touch similarly in both groups. Regarding the appropriateness, erogeneity, and pleasantness of social touch, the autistic group showed different touch perceptions in professional and friendly scenarios compared to the non-autistic group, whereas touch in intimate scenarios was perceived similarly. Sensory responsivity, touch predictability, social confidence, and touch-related anxiety affect social touch to a greater extent than the non-autistic group. Despite these marked differences in perception, the autistic adults, on average, engage in social touch as frequently as non-autistic adults, and their satisfaction with touch is comparable. Our findings suggest that supporting autistic people would involve understanding their preferences and the contextual factors that contribute to their sense of comfort, rather than excluding them from touch interactions. Lay Autistic people find certain types of touch, particularly light or unexpected touch, uncomfortable or overwhelming. The reasons for this are not fully understood. To address this, we asked both autistic and non-autistic adults how they feel about being touched in different situations and on different parts of the body. We also asked how much they enjoy touch and how they feel about being touched by people in various relationships, such as a partner, parent, or friend. Finally, we looked at how individual traits affect their experience of touch. We found that the autistic group engaged in social touch just as often as the non-autistic group and reported similar overall satisfaction. In intimate contexts, such as with a romantic partner, both groups perceived touch similarly. Both groups agreed that touch from a partner or child is the most meaningful and comfortable compared to other relationship types. Despite some similarities, autistic adults, on average, still reported enjoying social touch less overall and experiencing more touch-related challenges in romantic relationships. They also placed less importance on touch for bonding. Moreover, the autistic group rated touch as less appropriate, less pleasant, or less intimate than the non-autistic group in professional (like physiotherapy) or friendly (like a dance class) situations. While social interaction difficulties influence how both groups experience touch, other factors seem to play a stronger role for the autistic group, such as how predictable the touch is, whether they experience sensory challenges, and how socially confident they feel or how anxious about touch they are. Rather than assuming autistic people dislike touch, it is important to recognise that they may have different preferences, and that certain situations make touch feel more comfortable and enjoyable. Respecting these preferences can help make social touch more positive and meaningful, potentially improving relationship quality with autistic people.
- 30 December 2025
- Published by SAGE Publications in Autism
- Vol. 30 (3) , 626-641
Open AccessAutistic adults prefer social touch less but engage just as much: The impact of social context, relationship type, sensory responsivity, and psychological factors
Autistic people face touch-related challenges, yet the factors influencing these difficulties are not well understood. We developed a novel instrument to capture social touch experiences of autistic adults, along with both social and individual factors that influence them. Using a body-painting task and questionnaires, we demonstrated that the perception of touch interactions varies based on social contexts and neurotypes. Autistic adults, on average, prefer touch less, but the type of relationship influences the perceived comfort and meaningfulness of touch similarly in both groups. Regarding the appropriateness, erogeneity, and pleasantness of social touch, the autistic group showed different touch perceptions in professional and friendly scenarios compared to the non-autistic group, whereas touch in intimate scenarios was perceived similarly. Sensory responsivity, touch predictability, social confidence, and touch-related anxiety affect social touch to a greater extent than the non-autistic group. Despite these marked differences in perception, the autistic adults, on average, engage in social touch as frequently as non-autistic adults, and their satisfaction with touch is comparable. Our findings suggest that supporting autistic people would involve understanding their preferences and the contextual factors that contribute to their sense of comfort, rather than excluding them from touch interactions. Lay Autistic people find certain types of touch, particularly light or unexpected touch, uncomfortable or overwhelming. The reasons for this are not fully understood. To address this, we asked both autistic and non-autistic adults how they feel about being touched in different situations and on different parts of the body. We also asked how much they enjoy touch and how they feel about being touched by people in various relationships, such as a partner, parent, or friend. Finally, we looked at how individual traits affect their experience of touch. We found that the autistic group engaged in social touch just as often as the non-autistic group and reported similar overall satisfaction. In intimate contexts, such as with a romantic partner, both groups perceived touch similarly. Both groups agreed that touch from a partner or child is the most meaningful and comfortable compared to other relationship types. Despite some similarities, autistic adults, on average, still reported enjoying social touch less overall and experiencing more touch-related challenges in romantic relationships. They also placed less importance on touch for bonding. Moreover, the autistic group rated touch as less appropriate, less pleasant, or less intimate than the non-autistic group in professional (like physiotherapy) or friendly (like a dance class) situations. While social interaction difficulties influence how both groups experience touch, other factors seem to play a stronger role for the autistic group, such as how predictable the touch is, whether they experience sensory challenges, and how socially confident they feel or how anxious about touch they are. Rather than assuming autistic people dislike touch, it is important to recognise that they may have different preferences, and that certain situations make touch feel more comfortable and enjoyable. Respecting these preferences can help make social touch more positive and meaningful, potentially improving relationship quality with autistic people.
- Open Access
- 18 February 2025
- Published by Springer Nature in Molecular Autism
- Vol. 16 (1) , 1-17
Dynamic functional adaptations during touch observation in autism: connectivity strength is linked to attitudes towards social touch and social responsiveness
Background: Autistic adults experience differences in social interactions involving physical contact. Brain imaging studies suggest that these differences may be related to atypical brain responses to social-affective cues, affecting both the experience of receiving touch and observing it in others. However, it remains unclear whether these atypical responses are limited to specific brain regions or represent broader alterations in brain connectivity. The current study investigated how the functional network architecture is modulated during touch observation associated with autism and explored the extent to which changes in this architecture are associated with individual differences in social touch preferences and social responsiveness. Methods: By integrating generalized psychophysiological interaction (gPPI) analysis with independent component analysis (ICA), the current study analyzed existing fMRI datasets, in which 21 autistic and 21 non-autistic male adults viewed videos of social and nonsocial touch while undergoing MRI scans. Results: A gPPI analysis of regions of interest revealed that autistic adults exhibited increased connectivity between sensory and social brain regions. The strength of some of these connections was positively associated with a higher preference for social touch and greater social responsiveness, suggesting neural compensatory mechanisms that may help autistic adults better understand the meaning of touch. At the level of large-scale brain networks extracted using ICA, atypical connectivity was predominantly observed between the sensorimotor network and other networks involved in social-emotional processing. Increased connectivity was observed in the sensorimotor network during nonsocial touch, suggesting that embodied simulation, the process by which individuals internally simulate touch experience of others in this context, may be more engaged when observing human-object interactions than during human-to-human touch. Limitations: This study focused on a specific subgroup of 21 autistic male adults with minimal support needs. Future research would benefit from including a more diverse autistic sample. Conclusions: This study reveals atypical context-dependent modulation of functional brain architecture associated with autism during touch observation. Neural compensatory mechanisms in autistic individuals who enjoy social touch and show higher social responsiveness may function as adaptive social responses. However, these compensations may be limited to specific brain regions, rather than occurring at the level of large-scale brain networks.
- 18 February 2025
- Published by Springer Nature in Molecular Autism
- Vol. 16 (1) , 1-17
Open AccessDynamic functional adaptations during touch observation in autism: connectivity strength is linked to attitudes towards social touch and social responsiveness
Background: Autistic adults experience differences in social interactions involving physical contact. Brain imaging studies suggest that these differences may be related to atypical brain responses to social-affective cues, affecting both the experience of receiving touch and observing it in others. However, it remains unclear whether these atypical responses are limited to specific brain regions or represent broader alterations in brain connectivity. The current study investigated how the functional network architecture is modulated during touch observation associated with autism and explored the extent to which changes in this architecture are associated with individual differences in social touch preferences and social responsiveness. Methods: By integrating generalized psychophysiological interaction (gPPI) analysis with independent component analysis (ICA), the current study analyzed existing fMRI datasets, in which 21 autistic and 21 non-autistic male adults viewed videos of social and nonsocial touch while undergoing MRI scans. Results: A gPPI analysis of regions of interest revealed that autistic adults exhibited increased connectivity between sensory and social brain regions. The strength of some of these connections was positively associated with a higher preference for social touch and greater social responsiveness, suggesting neural compensatory mechanisms that may help autistic adults better understand the meaning of touch. At the level of large-scale brain networks extracted using ICA, atypical connectivity was predominantly observed between the sensorimotor network and other networks involved in social-emotional processing. Increased connectivity was observed in the sensorimotor network during nonsocial touch, suggesting that embodied simulation, the process by which individuals internally simulate touch experience of others in this context, may be more engaged when observing human-object interactions than during human-to-human touch. Limitations: This study focused on a specific subgroup of 21 autistic male adults with minimal support needs. Future research would benefit from including a more diverse autistic sample. Conclusions: This study reveals atypical context-dependent modulation of functional brain architecture associated with autism during touch observation. Neural compensatory mechanisms in autistic individuals who enjoy social touch and show higher social responsiveness may function as adaptive social responses. However, these compensations may be limited to specific brain regions, rather than occurring at the level of large-scale brain networks.
- Open Access
Dynamic functional adaptations during touch observation in autism: Connectivity strength is linked to attitudes towards social touch and social responsiveness
Autistic adults often experience differences in social interactions involving physical contact. Brain imaging studies suggest that these differences may be related to atypical brain responses to social-affective cues, affecting both the experience of receiving touch and observing it in others. However, it remains unclear whether these atypical responses are limited to specific brain regions or represent broader alterations in brain connectivity. The current study investigated how the functional network architecture is modulated during touch observation associated with autism and explored the extent to which changes in this architecture are associated with individual differences in social touch preferences and social responsiveness. By integrating generalized psychophysiological interaction (gPPI) analysis with independent component analysis (ICA), the current study analyzed existing fMRI datasets, in which 21 autistic and 21 non-autistic male adults viewed videos of social and nonsocial touch while undergoing MRI scans. A gPPI analysis of pre-defined regions of interest revealed that autistic adults exhibited increased connectivity between sensory and social brain regions. The strength of some of these connections was positively associated with a higher preference for social touch and greater social responsiveness, suggesting neural compensatory mechanisms that may help autistic adults better understand the meaning of touch. At the level of large-scale brain networks extracted using ICA, atypical connectivity was predominantly observed between the sensorimotor network and other networks involved in social-emotional processing. Increased connectivity was observed in the sensorimotor network during nonsocial touch, suggesting that embodied simulation, the process by which individuals internally simulate touch experience of others in this context, may be more engaged when observing human-object interactions than during human-to-human touch in autism. This study reveals atypical context-dependent modulation of functional brain architecture associated with autism during touch observation, suggesting that challenges in recognizing and using affective touch in social interactions may be associated with altered brain connectivity. Neural compensatory mechanisms in autistic individuals who enjoy social touch and show higher social responsiveness may function as adaptive social responses. However, these compensations appear to be limited to specific brain regions, rather than occurring at the level of large-scale brain networks.
Open AccessDynamic functional adaptations during touch observation in autism: Connectivity strength is linked to attitudes towards social touch and social responsiveness
Autistic adults often experience differences in social interactions involving physical contact. Brain imaging studies suggest that these differences may be related to atypical brain responses to social-affective cues, affecting both the experience of receiving touch and observing it in others. However, it remains unclear whether these atypical responses are limited to specific brain regions or represent broader alterations in brain connectivity. The current study investigated how the functional network architecture is modulated during touch observation associated with autism and explored the extent to which changes in this architecture are associated with individual differences in social touch preferences and social responsiveness. By integrating generalized psychophysiological interaction (gPPI) analysis with independent component analysis (ICA), the current study analyzed existing fMRI datasets, in which 21 autistic and 21 non-autistic male adults viewed videos of social and nonsocial touch while undergoing MRI scans. A gPPI analysis of pre-defined regions of interest revealed that autistic adults exhibited increased connectivity between sensory and social brain regions. The strength of some of these connections was positively associated with a higher preference for social touch and greater social responsiveness, suggesting neural compensatory mechanisms that may help autistic adults better understand the meaning of touch. At the level of large-scale brain networks extracted using ICA, atypical connectivity was predominantly observed between the sensorimotor network and other networks involved in social-emotional processing. Increased connectivity was observed in the sensorimotor network during nonsocial touch, suggesting that embodied simulation, the process by which individuals internally simulate touch experience of others in this context, may be more engaged when observing human-object interactions than during human-to-human touch in autism. This study reveals atypical context-dependent modulation of functional brain architecture associated with autism during touch observation, suggesting that challenges in recognizing and using affective touch in social interactions may be associated with altered brain connectivity. Neural compensatory mechanisms in autistic individuals who enjoy social touch and show higher social responsiveness may function as adaptive social responses. However, these compensations appear to be limited to specific brain regions, rather than occurring at the level of large-scale brain networks.
- Open Access
- 10 February 2024
- Published by Elsevier in Neuropsychologia
- Vol. 196, 108823
A shared neural code for perceiving and remembering social interactions in the human superior temporal sulcus
- 10 February 2024
- Published by Elsevier in Neuropsychologia
- Vol. 196, 108823
Open AccessA shared neural code for perceiving and remembering social interactions in the human superior temporal sulcus
- Open Access
- 1 January 2024
- Published by Oxford University Press (OUP) in Social Cognitive and Affective Neuroscience
- Vol. 19 (1)
Multidimensional neural representations of social features during movie viewing
The social world is dynamic and contextually embedded. Yet, most studies utilize simple stimuli that do not capture the complexity of everyday social episodes. To address this, we implemented a movie viewing paradigm and investigated how everyday social episodes are processed in the brain. Participants watched one of two movies during an MRI scan. Neural patterns from brain regions involved in social perception, mentalization, action observation and sensory processing were extracted. Representational similarity analysis results revealed that several labeled social features (including social interaction, mentalization, the actions of others, characters talking about themselves, talking about others and talking about objects) were represented in the superior temporal gyrus (STG) and middle temporal gyrus (MTG). The mentalization feature was also represented throughout the theory of mind network, and characters talking about others engaged the temporoparietal junction (TPJ), suggesting that listeners may spontaneously infer the mental state of those being talked about. In contrast, we did not observe the action representations in the frontoparietal regions of the action observation network. The current findings indicate that STG and MTG serve as key regions for social processing, and that listening to characters talk about others elicits spontaneous mental state inference in TPJ during natural movie viewing.
- 1 January 2024
- Published by Oxford University Press (OUP) in Social Cognitive and Affective Neuroscience
- Vol. 19 (1)
Open AccessMultidimensional neural representations of social features during movie viewing
The social world is dynamic and contextually embedded. Yet, most studies utilize simple stimuli that do not capture the complexity of everyday social episodes. To address this, we implemented a movie viewing paradigm and investigated how everyday social episodes are processed in the brain. Participants watched one of two movies during an MRI scan. Neural patterns from brain regions involved in social perception, mentalization, action observation and sensory processing were extracted. Representational similarity analysis results revealed that several labeled social features (including social interaction, mentalization, the actions of others, characters talking about themselves, talking about others and talking about objects) were represented in the superior temporal gyrus (STG) and middle temporal gyrus (MTG). The mentalization feature was also represented throughout the theory of mind network, and characters talking about others engaged the temporoparietal junction (TPJ), suggesting that listeners may spontaneously infer the mental state of those being talked about. In contrast, we did not observe the action representations in the frontoparietal regions of the action observation network. The current findings indicate that STG and MTG serve as key regions for social processing, and that listening to characters talk about others elicits spontaneous mental state inference in TPJ during natural movie viewing.
- Open Access
Multidimensional neural representations of social features during movie viewing
The social world is dynamic and contextually embedded. Yet, most studies utilize simple stimuli that do not capture the complexity of everyday social episodes. To address this, we implemented a movie viewing paradigm and investigated how the everyday social episodes are processed in the brain. Participants watched one of two movies during an MRI scan. Neural patterns from brain regions involved in social perception, mentalization, action observation, and sensory processing were extracted. Representational similarity analysis results revealed that several labeled social features (including social interaction, mentalization, the actions of others, characters talking about themselves, talking about others, and talking about objects) were represented in superior temporal gyrus (STG) and middle temporal gyrus (MTG). The mentalization feature was also represented throughout the theory of mind network, and characters talking about others engaged the temporoparietal junction (TPJ), suggesting that listeners may spontaneously infer the mental state of those being talked about. In contrast, we did not observe the action representations in frontoparietal regions of the action observation network. The current findings indicate that STG and MTG serve as central hubs for social processing, and that listening to characters talk about others elicits spontaneous mental state inference in TPJ during natural movie viewing.
Open AccessMultidimensional neural representations of social features during movie viewing
The social world is dynamic and contextually embedded. Yet, most studies utilize simple stimuli that do not capture the complexity of everyday social episodes. To address this, we implemented a movie viewing paradigm and investigated how the everyday social episodes are processed in the brain. Participants watched one of two movies during an MRI scan. Neural patterns from brain regions involved in social perception, mentalization, action observation, and sensory processing were extracted. Representational similarity analysis results revealed that several labeled social features (including social interaction, mentalization, the actions of others, characters talking about themselves, talking about others, and talking about objects) were represented in superior temporal gyrus (STG) and middle temporal gyrus (MTG). The mentalization feature was also represented throughout the theory of mind network, and characters talking about others engaged the temporoparietal junction (TPJ), suggesting that listeners may spontaneously infer the mental state of those being talked about. In contrast, we did not observe the action representations in frontoparietal regions of the action observation network. The current findings indicate that STG and MTG serve as central hubs for social processing, and that listening to characters talk about others elicits spontaneous mental state inference in TPJ during natural movie viewing.
- Open Access
- 23 October 2023
- Published by Society for Neuroscience in The Journal of Neuroscience
- Vol. 43 (45) , 7700-7711
Rapid Processing of Observed Touch through Social Perceptual Brain Regions: An EEG-fMRI Fusion Study
Seeing social touch triggers a strong social-affective response that involves multiple brain networks, including visual, social perceptual, and somatosensory systems. Previous studies have identified the specific functional role of each system, but little is known about the speed and directionality of the information flow. Is this information extracted via the social perceptual system or from simulation from somatosensory cortex? To address this, we examined the spatiotemporal neural processing of observed touch. Twenty-one human participants (seven males) watched 500-ms video clips showing social and nonsocial touch during electroencephalogram (EEG) recording. Visual and social-affective features were rapidly extracted in the brain, beginning at 90 and 150 ms after video onset, respectively. Combining the EEG data with functional magnetic resonance imaging (fMRI) data from our prior study with the same stimuli reveals that neural information first arises in early visual cortex (EVC), then in the temporoparietal junction and posterior superior temporal sulcus (TPJ/pSTS), and finally in the somatosensory cortex. EVC and TPJ/pSTS uniquely explain EEG neural patterns, while somatosensory cortex does not contribute to EEG patterns alone, suggesting that social-affective information may flow from TPJ/pSTS to somatosensory cortex. Together, these findings show that social touch is processed quickly, within the timeframe of feedforward visual processes, and that the social-affective meaning of touch is first extracted by a social perceptual pathway. Such rapid processing of social touch may be vital to its effective use during social interaction.SIGNIFICANCE STATEMENTSeeing physical contact between people evokes a strong social-emotional response. Previous research has identified the brain systems responsible for this response, but little is known about how quickly and in what direction the information flows. We demonstrated that the brain processes the social-emotional meaning of observed touch quickly, starting as early as 150 ms after the stimulus onset. By combining electroencephalogram (EEG) data with functional magnetic resonance imaging (fMRI) data, we show for the first time that the social-affective meaning of touch is first extracted by a social perceptual pathway and followed by the later involvement of somatosensory simulation. This rapid processing of touch through the social perceptual route may play a pivotal role in effective usage of touch in social communication and interaction.
- 23 October 2023
- Published by Society for Neuroscience in The Journal of Neuroscience
- Vol. 43 (45) , 7700-7711
Open AccessRapid Processing of Observed Touch through Social Perceptual Brain Regions: An EEG-fMRI Fusion Study
Seeing social touch triggers a strong social-affective response that involves multiple brain networks, including visual, social perceptual, and somatosensory systems. Previous studies have identified the specific functional role of each system, but little is known about the speed and directionality of the information flow. Is this information extracted via the social perceptual system or from simulation from somatosensory cortex? To address this, we examined the spatiotemporal neural processing of observed touch. Twenty-one human participants (seven males) watched 500-ms video clips showing social and nonsocial touch during electroencephalogram (EEG) recording. Visual and social-affective features were rapidly extracted in the brain, beginning at 90 and 150 ms after video onset, respectively. Combining the EEG data with functional magnetic resonance imaging (fMRI) data from our prior study with the same stimuli reveals that neural information first arises in early visual cortex (EVC), then in the temporoparietal junction and posterior superior temporal sulcus (TPJ/pSTS), and finally in the somatosensory cortex. EVC and TPJ/pSTS uniquely explain EEG neural patterns, while somatosensory cortex does not contribute to EEG patterns alone, suggesting that social-affective information may flow from TPJ/pSTS to somatosensory cortex. Together, these findings show that social touch is processed quickly, within the timeframe of feedforward visual processes, and that the social-affective meaning of touch is first extracted by a social perceptual pathway. Such rapid processing of social touch may be vital to its effective use during social interaction.SIGNIFICANCE STATEMENTSeeing physical contact between people evokes a strong social-emotional response. Previous research has identified the brain systems responsible for this response, but little is known about how quickly and in what direction the information flows. We demonstrated that the brain processes the social-emotional meaning of observed touch quickly, starting as early as 150 ms after the stimulus onset. By combining electroencephalogram (EEG) data with functional magnetic resonance imaging (fMRI) data, we show for the first time that the social-affective meaning of touch is first extracted by a social perceptual pathway and followed by the later involvement of somatosensory simulation. This rapid processing of touch through the social perceptual route may play a pivotal role in effective usage of touch in social communication and interaction.
- Open Access
- 9 August 2023
- Published by Elsevier in Data in Brief
- Vol. 50, 109490
Word-timestamped transcripts of two spoken narrative recall functional neuroimaging datasets
- 9 August 2023
- Published by Elsevier in Data in Brief
- Vol. 50, 109490
Open AccessWord-timestamped transcripts of two spoken narrative recall functional neuroimaging datasets
- Open Access
Rapid processing of observed touch through social perceptual brain regions: an EEG-fMRI fusion study
Seeing social touch triggers a strong social-affective response that involves multiple brain networks, including visual, social perceptual, and somatosensory systems. Previous studies have identified the specific functional role of each system, but little is known about the speed and directionality of the information flow. Is this information extracted via the social perceptual system or from simulation from somatosensory cortex? To address this, we examined the spatiotemporal neural processing of observed touch. Twenty participants watched 500 ms video clips showing social and non-social touch during EEG recording. Visual and social-affective features were rapidly extracted in the brain, beginning at 90 and 150 ms after video onset, respectively. Combining the EEG data with fMRI data from our prior study with the same stimuli reveals that neural information first arises in early visual cortex (EVC), then in the temporoparietal junction and posterior superior temporal sulcus (TPJ/pSTS), and finally in the somatosensory cortex. EVC and TPJ/pSTS uniquely explain EEG neural patterns, while somatosensory cortex does not contribute to EEG patterns alone, suggesting that social-affective information may flow from TPJ/pSTS to somatosensory cortex. Together, these findings show that social touch is processed quickly, within the timeframe of feedforward visual processes, and that the social-affective meaning of touch is first extracted by a social perceptual pathway. Such rapid processing of social touch may be vital to its effective use during social interaction. Significance Statement: Seeing physical contact between people evokes a strong social-emotional response. Previous research has identified the brain systems responsible for this response, but little is known about how quickly and in what direction the information flows. We demonstrated that the brain processes the social-emotional meaning of observed touch quickly, starting as early as 150 milliseconds after the stimulus onset. By combining EEG data with fMRI data, we show for the first time that the social-affective meaning of touch is first extracted by a social perceptual pathway and followed by the later involvement of somatosensory simulation. This rapid processing of touch through the social perceptual route may play a pivotal role in effective usage of touch in social communication and interaction.
Open AccessRapid processing of observed touch through social perceptual brain regions: an EEG-fMRI fusion study
Seeing social touch triggers a strong social-affective response that involves multiple brain networks, including visual, social perceptual, and somatosensory systems. Previous studies have identified the specific functional role of each system, but little is known about the speed and directionality of the information flow. Is this information extracted via the social perceptual system or from simulation from somatosensory cortex? To address this, we examined the spatiotemporal neural processing of observed touch. Twenty participants watched 500 ms video clips showing social and non-social touch during EEG recording. Visual and social-affective features were rapidly extracted in the brain, beginning at 90 and 150 ms after video onset, respectively. Combining the EEG data with fMRI data from our prior study with the same stimuli reveals that neural information first arises in early visual cortex (EVC), then in the temporoparietal junction and posterior superior temporal sulcus (TPJ/pSTS), and finally in the somatosensory cortex. EVC and TPJ/pSTS uniquely explain EEG neural patterns, while somatosensory cortex does not contribute to EEG patterns alone, suggesting that social-affective information may flow from TPJ/pSTS to somatosensory cortex. Together, these findings show that social touch is processed quickly, within the timeframe of feedforward visual processes, and that the social-affective meaning of touch is first extracted by a social perceptual pathway. Such rapid processing of social touch may be vital to its effective use during social interaction. Significance Statement: Seeing physical contact between people evokes a strong social-emotional response. Previous research has identified the brain systems responsible for this response, but little is known about how quickly and in what direction the information flows. We demonstrated that the brain processes the social-emotional meaning of observed touch quickly, starting as early as 150 milliseconds after the stimulus onset. By combining EEG data with fMRI data, we show for the first time that the social-affective meaning of touch is first extracted by a social perceptual pathway and followed by the later involvement of somatosensory simulation. This rapid processing of touch through the social perceptual route may play a pivotal role in effective usage of touch in social communication and interaction.
- Open Access
A shared neural code for social interaction encoding and memory in the human superior temporal sulcus
Recognizing and remembering social information is a crucial cognitive skill. Neural patterns in the superior temporal sulcus (STS) support our ability to perceive others’ social interactions. However, despite the prominence of social interactions in memory, the neural basis of retrieving social interactions is still unknown. To fill this gap, we investigated the brain mechanisms underlying memory of others’ social interactions during free spoken recall of a naturalistic movie. By applying machine learning-based fMRI encoding analyses to densely labeled movie and recall data we found that STS activity patterns evoked by viewing social interactions predicted neural responses to social interaction memories. This finding suggests that the STS contains high-level conceptual, representations of social interactions, and its reactivation underlies our ability to remember others’ interactions.
Open AccessA shared neural code for social interaction encoding and memory in the human superior temporal sulcus
Recognizing and remembering social information is a crucial cognitive skill. Neural patterns in the superior temporal sulcus (STS) support our ability to perceive others’ social interactions. However, despite the prominence of social interactions in memory, the neural basis of retrieving social interactions is still unknown. To fill this gap, we investigated the brain mechanisms underlying memory of others’ social interactions during free spoken recall of a naturalistic movie. By applying machine learning-based fMRI encoding analyses to densely labeled movie and recall data we found that STS activity patterns evoked by viewing social interactions predicted neural responses to social interaction memories. This finding suggests that the STS contains high-level conceptual, representations of social interactions, and its reactivation underlies our ability to remember others’ interactions.