Yujie Tao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Yujie Tao has a total of 30 co-authors. Here are the top co-authors by number of shared publications:
- Sean Follmer
Stanford University, Stanford, California, USA
4 shared publications - Alexander T. Adams
School of Interactive Computing, Georgia Institute of Technology, Atlanta, Georgia, USA
3 shared publications - Jeremy N. Bailenson
Stanford University, Stanford, California, USA
3 shared publications - Pedro Lopes
University of Chicago, Chicago, Illinois, USA
3 shared publications - Tanzeem Choudhury
Cornell Tech, New York, New York, USA
3 shared publications - Yiran Zhao
Cornell University, New York, USA
3 shared publications
Latest Publications
- Open Access
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Reperceiving Everyday Sounds with Hidden Texture
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Open AccessReperceiving Everyday Sounds with Hidden Texture
- Open Access
- 9 December 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 32 (6) , 1-34
Audio Personas: Augmenting Social Perception via Body-Anchored Audio Cues
We introduce Audio Personas, enabling users to “decorate” themselves with body-anchored sounds in audio augmented reality. Like outfits, makeup, and fragrances, audio personas offer an alternative yet dynamic channel to augment face-to-face interactions. For instance, one can set their audio persona as rain sounds to reflect a bad mood, bee sounds to establish personal boundaries, or a playful “woosh” sound to mimic passing by someone like a breeze. To instantiate the concept, we implemented a headphone-based prototype with multi-user tracking and audio streaming. Our preregistered in-lab study with 64 participants showed that audio personas influenced how participants formed impressions. Individuals with positive audio personas were rated as more socially attractive, more likable, and less threatening than those with negative audio personas. Our study with audio designers revealed that audio personas were preferred in public and semi-public-private spaces for managing social impressions (e.g., personality) and signaling current states (e.g., emotions).
- 9 December 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 32 (6) , 1-34
Open AccessAudio Personas: Augmenting Social Perception via Body-Anchored Audio Cues
We introduce Audio Personas, enabling users to “decorate” themselves with body-anchored sounds in audio augmented reality. Like outfits, makeup, and fragrances, audio personas offer an alternative yet dynamic channel to augment face-to-face interactions. For instance, one can set their audio persona as rain sounds to reflect a bad mood, bee sounds to establish personal boundaries, or a playful “woosh” sound to mimic passing by someone like a breeze. To instantiate the concept, we implemented a headphone-based prototype with multi-user tracking and audio streaming. Our preregistered in-lab study with 64 participants showed that audio personas influenced how participants formed impressions. Individuals with positive audio personas were rated as more socially attractive, more likable, and less threatening than those with negative audio personas. Our study with audio designers revealed that audio personas were preferred in public and semi-public-private spaces for managing social impressions (e.g., personality) and signaling current states (e.g., emotions).
- Open Access
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-27
Audio Augmentation of Manual Interactions to Support Mindfulness
Mindfulness is the state of maintaining attention to the present moment with curiosity and openness. Existing mobile technologies to support mindfulness focus on formal practices such as meditation, requiring dedicated space and time. However, everyday mindfulness—a more flexible form of practice woven into routine activities such as washing hands or cooking—remains under-supported. To address this gap, we introduce a wearable device that adopts a sensory-driven approach to foster two key components of mindfulness, attention and curiosity, in everyday contexts. Our device amplifies sounds produced by the user's hand interactions to make them more salient, such as the sounds of hands rubbing together or fingertips sliding across surfaces. By playing back the amplified sounds to the user in real time, the device leads to a fresh perspective on mundane interactions. We conducted a preregistered in-lab study with 60 participants to evaluate the device in an everyday task: object exploration. We found that audio augmentation enhanced self-reported state mindfulness, directing user attention to auditory properties of objects that would otherwise be overlooked. Behaviorally, audio augmentation caused participants to interact with objects for a longer duration than participants who did not experience audio augmentation. We also found that participants exhibited more trial-and-error exploratory behavior patterns with audio augmentation than without, suggesting increased curiosity.
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-27
Open AccessAudio Augmentation of Manual Interactions to Support Mindfulness
Mindfulness is the state of maintaining attention to the present moment with curiosity and openness. Existing mobile technologies to support mindfulness focus on formal practices such as meditation, requiring dedicated space and time. However, everyday mindfulness—a more flexible form of practice woven into routine activities such as washing hands or cooking—remains under-supported. To address this gap, we introduce a wearable device that adopts a sensory-driven approach to foster two key components of mindfulness, attention and curiosity, in everyday contexts. Our device amplifies sounds produced by the user's hand interactions to make them more salient, such as the sounds of hands rubbing together or fingertips sliding across surfaces. By playing back the amplified sounds to the user in real time, the device leads to a fresh perspective on mundane interactions. We conducted a preregistered in-lab study with 60 participants to evaluate the device in an everyday task: object exploration. We found that audio augmentation enhanced self-reported state mindfulness, directing user attention to auditory properties of objects that would otherwise be overlooked. Behaviorally, audio augmentation caused participants to interact with objects for a longer duration than participants who did not experience audio augmentation. We also found that participants exhibited more trial-and-error exploratory behavior patterns with audio augmentation than without, suggesting increased curiosity.
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Toward Everyday Perceptual and Physiological Augmentation
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessToward Everyday Perceptual and Physiological Augmentation
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Sensory Scaffolding to Reconnect Users with the Ordinary
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessSensory Scaffolding to Reconnect Users with the Ordinary
- Open Access
- 10 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-3
BEASTS: Dual Perspectives on Virtual Puppetry through Theatrical Expression and XR Research
- 10 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessBEASTS: Dual Perspectives on Virtual Puppetry through Theatrical Expression and XR Research
- Open Access
- 31 December 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e54438
Translation Effectiveness of Offset Heart Rate Biofeedback as a Mindless Intervention for Alcohol Craving Among Risky Drinkers: Controlled Experiment
Background: Digital and wearable intervention systems promise to improve how people manage their behavioral health conditions by making interventions available when the user can best benefit from them. However, existing interventions are obtrusive because they require attention and motivation to engage in, limiting the effectiveness of such systems in demanding contexts, such as when the user experiences alcohol craving. Mindless interventions, developed by the human-computer interaction community, offer an opportunity to intervene unobtrusively. Offset heart rate biofeedback is an iconic type of mindless intervention powered by entrainment and can mitigate the physiological and psychological response to stressors. Objective: This work aimed to characterize the translational effectiveness of offset heart rate biofeedback on cue-elicit alcohol craving among risky drinkers. Methods: We conducted an out-of-lab, between-group, controlled experiment with 26 participants who performed harmful or hazardous drinking. The control group served as negative control and received no intervention, while the experimental group received offset heart rate biofeedback during alcohol exposure and recovery. We elicited alcohol cravings through a series of alcohol cues, including performing mental imagery, viewing alcohol images, and sniffing alcohol. We measured the physiological response to alcohol (ie, heart rate variability), self-reported craving, and self-reported anxiety. We constructed linear mixed-effects models to understand the effect of intervention during alcohol exposure and alcohol recovery after exposure. Following the linear mixed effect model, we conducted pair-wise comparisons for measures between the control and experimental groups. Results: We found that offset heart rate biofeedback significantly reduced the increase in heart rate variability (P=.01 and P=.052) and self-reported craving (P=.04 and P=.02) in response to alcohol cues. Participants’ anxiety was not affected by either the alcohol cues or the offset heart rate biofeedback. Conclusions: Offset heart rate biofeedback has the potential to immediately and unobtrusively mitigate cue-elicit alcohol craving among risky drinkers. The results of this study opened new opportunities for digital and wearable interventions to mitigate alcohol craving, either as wellness apps for risky drinkers or as digital prescriptions and integration with sensing systems for people with alcohol dependency.
- 31 December 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e54438
Open AccessTranslation Effectiveness of Offset Heart Rate Biofeedback as a Mindless Intervention for Alcohol Craving Among Risky Drinkers: Controlled Experiment
Background: Digital and wearable intervention systems promise to improve how people manage their behavioral health conditions by making interventions available when the user can best benefit from them. However, existing interventions are obtrusive because they require attention and motivation to engage in, limiting the effectiveness of such systems in demanding contexts, such as when the user experiences alcohol craving. Mindless interventions, developed by the human-computer interaction community, offer an opportunity to intervene unobtrusively. Offset heart rate biofeedback is an iconic type of mindless intervention powered by entrainment and can mitigate the physiological and psychological response to stressors. Objective: This work aimed to characterize the translational effectiveness of offset heart rate biofeedback on cue-elicit alcohol craving among risky drinkers. Methods: We conducted an out-of-lab, between-group, controlled experiment with 26 participants who performed harmful or hazardous drinking. The control group served as negative control and received no intervention, while the experimental group received offset heart rate biofeedback during alcohol exposure and recovery. We elicited alcohol cravings through a series of alcohol cues, including performing mental imagery, viewing alcohol images, and sniffing alcohol. We measured the physiological response to alcohol (ie, heart rate variability), self-reported craving, and self-reported anxiety. We constructed linear mixed-effects models to understand the effect of intervention during alcohol exposure and alcohol recovery after exposure. Following the linear mixed effect model, we conducted pair-wise comparisons for measures between the control and experimental groups. Results: We found that offset heart rate biofeedback significantly reduced the increase in heart rate variability (P=.01 and P=.052) and self-reported craving (P=.04 and P=.02) in response to alcohol cues. Participants’ anxiety was not affected by either the alcohol cues or the offset heart rate biofeedback. Conclusions: Offset heart rate biofeedback has the potential to immediately and unobtrusively mitigate cue-elicit alcohol craving among risky drinkers. The results of this study opened new opportunities for digital and wearable interventions to mitigate alcohol craving, either as wellness apps for risky drinkers or as digital prescriptions and integration with sensing systems for people with alcohol dependency.
- Open Access
- 13 December 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Translation Effectiveness of Offset Heart Rate Biofeedback as a Mindless Intervention for Alcohol Craving Among Risky Drinkers: Controlled Experiment (Preprint)
BACKGROUND Digital and wearable intervention systems promise to improve how people manage their behavioral health conditions by making interventions available when the user can best benefit from them. However, existing interventions are obtrusive because they require attention and motivation to engage in, limiting the effectiveness of such systems in demanding contexts, such as when the user experiences alcohol craving. Mindless interventions, developed by the human-computer interaction community, offer an opportunity to intervene unobtrusively. Offset heart rate biofeedback is an iconic type of mindless intervention powered by entrainment and can mitigate the physiological and psychological response to stressors. OBJECTIVE This work aimed to characterize the translational effectiveness of offset heart rate biofeedback on cue-elicit alcohol craving among risky drinkers. METHODS We conducted an out-of-lab, between-group, controlled experiment with 26 participants who performed harmful or hazardous drinking. The control group served as negative control and received no intervention, while the experimental group received offset heart rate biofeedback during alcohol exposure and recovery. We elicited alcohol cravings through a series of alcohol cues, including performing mental imagery, viewing alcohol images, and sniffing alcohol. We measured the physiological response to alcohol (ie, heart rate variability), self-reported craving, and self-reported anxiety. We constructed linear mixed-effects models to understand the effect of intervention during alcohol exposure and alcohol recovery after exposure. Following the linear mixed effect model, we conducted pair-wise comparisons for measures between the control and experimental groups. RESULTS We found that offset heart rate biofeedback significantly reduced the increase in heart rate variability (P=.01 and P=.052) and self-reported craving (P=.04 and P=.02) in response to alcohol cues. Participants’ anxiety was not affected by either the alcohol cues or the offset heart rate biofeedback. CONCLUSIONS Offset heart rate biofeedback has the potential to immediately and unobtrusively mitigate cue-elicit alcohol craving among risky drinkers. The results of this study opened new opportunities for digital and wearable interventions to mitigate alcohol craving, either as wellness apps for risky drinkers or as digital prescriptions and integration with sensing systems for people with alcohol dependency.
- 13 December 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessTranslation Effectiveness of Offset Heart Rate Biofeedback as a Mindless Intervention for Alcohol Craving Among Risky Drinkers: Controlled Experiment (Preprint)
BACKGROUND Digital and wearable intervention systems promise to improve how people manage their behavioral health conditions by making interventions available when the user can best benefit from them. However, existing interventions are obtrusive because they require attention and motivation to engage in, limiting the effectiveness of such systems in demanding contexts, such as when the user experiences alcohol craving. Mindless interventions, developed by the human-computer interaction community, offer an opportunity to intervene unobtrusively. Offset heart rate biofeedback is an iconic type of mindless intervention powered by entrainment and can mitigate the physiological and psychological response to stressors. OBJECTIVE This work aimed to characterize the translational effectiveness of offset heart rate biofeedback on cue-elicit alcohol craving among risky drinkers. METHODS We conducted an out-of-lab, between-group, controlled experiment with 26 participants who performed harmful or hazardous drinking. The control group served as negative control and received no intervention, while the experimental group received offset heart rate biofeedback during alcohol exposure and recovery. We elicited alcohol cravings through a series of alcohol cues, including performing mental imagery, viewing alcohol images, and sniffing alcohol. We measured the physiological response to alcohol (ie, heart rate variability), self-reported craving, and self-reported anxiety. We constructed linear mixed-effects models to understand the effect of intervention during alcohol exposure and alcohol recovery after exposure. Following the linear mixed effect model, we conducted pair-wise comparisons for measures between the control and experimental groups. RESULTS We found that offset heart rate biofeedback significantly reduced the increase in heart rate variability (P=.01 and P=.052) and self-reported craving (P=.04 and P=.02) in response to alcohol cues. Participants’ anxiety was not affected by either the alcohol cues or the offset heart rate biofeedback. CONCLUSIONS Offset heart rate biofeedback has the potential to immediately and unobtrusively mitigate cue-elicit alcohol craving among risky drinkers. The results of this study opened new opportunities for digital and wearable interventions to mitigate alcohol craving, either as wellness apps for risky drinkers or as digital prescriptions and integration with sensing systems for people with alcohol dependency.
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Embodying Physics-Aware Avatars in Virtual Reality
Embodiment toward an avatar in virtual reality (VR) is generally stronger when there is a high degree of alignment between the user’s and self-avatar’s motion. However, one-to-one mapping between the two is not always ideal when user interacts with the virtual environment. On these occasions, the user input often leads to unnatural behavior without physical realism (e.g., objects penetrating virtual body, body unmoved by hitting stimuli). We investigate how adding physics correction to self-avatar motion impacts embodiment. Physics-aware self-avatar preserves the physical meaning of the movement but introduces discrepancies between the user’s and self-avatar’s motion, whose contingency is a determining factor for embodiment. To understand its impact, we conducted an in-lab study (n = 20) where participants interacted with obstacles on their upper bodies in VR with and without physics correction. Our results showed that, rather than compromising embodiment level, physics-responsive self-avatar improved embodiment compared to no-physics condition in both active and passive interactions.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessEmbodying Physics-Aware Avatars in Virtual Reality
Embodiment toward an avatar in virtual reality (VR) is generally stronger when there is a high degree of alignment between the user’s and self-avatar’s motion. However, one-to-one mapping between the two is not always ideal when user interacts with the virtual environment. On these occasions, the user input often leads to unnatural behavior without physical realism (e.g., objects penetrating virtual body, body unmoved by hitting stimuli). We investigate how adding physics correction to self-avatar motion impacts embodiment. Physics-aware self-avatar preserves the physical meaning of the movement but introduces discrepancies between the user’s and self-avatar’s motion, whose contingency is a determining factor for embodiment. To understand its impact, we conducted an in-lab study (n = 20) where participants interacted with obstacles on their upper bodies in VR with and without physics correction. Our results showed that, rather than compromising embodiment level, physics-responsive self-avatar improved embodiment compared to no-physics condition in both active and passive interactions.
- Open Access
- 21 December 2022
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 6 (4) , 1-23
Affective Touch as Immediate and Passive Wearable Intervention
We investigated affective touch as a new pathway to passively mitigate in-the-moment anxiety. While existing mobile interventions offer great promises for health and well-being, they typically focus on achieving long-term effects such as shifting behaviors. As such, most mobile interventions are not applicable to provide immediate help in acute conditions -- when a user experiences a high anxiety level during ongoing events (e.g., completing high-stake tasks or mitigating interpersonal conflicts). A few works have developed passive interventions that are effective in-the-moment by leveraging breathing regulations and biofeedback. In this paper, we drew on neuroscientific findings on affective touch, the slow stroking on hairy skin that can elicit innate pleasantness and evaluated affective touch as a mobile health intervention. To induce affective touch, we first engineered a wearable device that renders a soft stroking sensation on the user's forearm. Then, we conducted a between-group experiment, in which participants underwent high-stress situations with/without receiving affective touch and post-experiment interviews, with 24 participants. Our results showed that participants who received affective touch experienced lower state anxiety and the same physiological stress response level compared to the control group participants. We also found that affective touch facilitated emotion regulation by rendering pleasantness, providing emotional support, and shifting attention. Finally, we discussed the immediate effect of affective touch on anxiety and physiological stress, the benefits of affective touch as a passive intervention, and the implementation considerations to use affective touch in just-in-time systems.
- 21 December 2022
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 6 (4) , 1-23
Open AccessAffective Touch as Immediate and Passive Wearable Intervention
We investigated affective touch as a new pathway to passively mitigate in-the-moment anxiety. While existing mobile interventions offer great promises for health and well-being, they typically focus on achieving long-term effects such as shifting behaviors. As such, most mobile interventions are not applicable to provide immediate help in acute conditions -- when a user experiences a high anxiety level during ongoing events (e.g., completing high-stake tasks or mitigating interpersonal conflicts). A few works have developed passive interventions that are effective in-the-moment by leveraging breathing regulations and biofeedback. In this paper, we drew on neuroscientific findings on affective touch, the slow stroking on hairy skin that can elicit innate pleasantness and evaluated affective touch as a mobile health intervention. To induce affective touch, we first engineered a wearable device that renders a soft stroking sensation on the user's forearm. Then, we conducted a between-group experiment, in which participants underwent high-stress situations with/without receiving affective touch and post-experiment interviews, with 24 participants. Our results showed that participants who received affective touch experienced lower state anxiety and the same physiological stress response level compared to the control group participants. We also found that affective touch facilitated emotion regulation by rendering pleasantness, providing emotional support, and shifting attention. Finally, we discussed the immediate effect of affective touch on anxiety and physiological stress, the benefits of affective touch as a passive intervention, and the implementation considerations to use affective touch in just-in-time systems.