YTYujie Tao

Yujie Tao

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Yujie Tao has a total of 30 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Reperceiving Everyday Sounds with Hidden Texture

    by Yujie Tao, Mateo Larrea, Portia Wang, Jingjin Li, Takako Fujioka, Jane L. E, Sean Follmer

  • Open Access

    Audio Personas: Augmenting Social Perception via Body-Anchored Audio Cues

    by Yujie Tao, Libby Ye, Jeremy N. Bailenson, Sean Follmer

    We introduce Audio Personas, enabling users to “decorate” themselves with body-anchored sounds in audio augmented reality. Like outfits, makeup, and fragrances, audio personas offer an alternative yet dynamic channel to augment face-to-face interactions. For instance, one can set their audio persona as rain sounds to reflect a bad mood, bee sounds to establish personal boundaries, or a playful “woosh” sound to mimic passing by someone like a breeze. To instantiate the concept, we implemented a headphone-based prototype with multi-user tracking and audio streaming. Our preregistered in-lab study with 64 participants showed that audio personas influenced how participants formed impressions. Individuals with positive audio personas were rated as more socially attractive, more likable, and less threatening than those with negative audio personas. Our study with audio designers revealed that audio personas were preferred in public and semi-public-private spaces for managing social impressions (e.g., personality) and signaling current states (e.g., emotions).


  • Open Access

    Audio Augmentation of Manual Interactions to Support Mindfulness

    by Yujie Tao, Jingjin Li, Libby Ye, Andrew Zhang, Jeremy N. Bailenson, Sean Follmer

    Mindfulness is the state of maintaining attention to the present moment with curiosity and openness. Existing mobile technologies to support mindfulness focus on formal practices such as meditation, requiring dedicated space and time. However, everyday mindfulness—a more flexible form of practice woven into routine activities such as washing hands or cooking—remains under-supported. To address this gap, we introduce a wearable device that adopts a sensory-driven approach to foster two key components of mindfulness, attention and curiosity, in everyday contexts. Our device amplifies sounds produced by the user's hand interactions to make them more salient, such as the sounds of hands rubbing together or fingertips sliding across surfaces. By playing back the amplified sounds to the user in real time, the device leads to a fresh perspective on mundane interactions. We conducted a preregistered in-lab study with 60 participants to evaluate the device in an everyday task: object exploration. We found that audio augmentation enhanced self-reported state mindfulness, directing user attention to auditory properties of objects that would otherwise be overlooked. Behaviorally, audio augmentation caused participants to interact with objects for a longer duration than participants who did not experience audio augmentation. We also found that participants exhibited more trial-and-error exploratory behavior patterns with audio augmentation than without, suggesting increased curiosity.


  • Open Access

    Toward Everyday Perceptual and Physiological Augmentation

    by Yujie Tao, Tan Gemicioglu, Sam Chin, Bingjian Huang, Jas Brooks, Sean Follmer, Pedro Lopes, Suranga Nanayakkara


  • Open Access

    BEASTS: Dual Perspectives on Virtual Puppetry through Theatrical Expression and XR Research

    by Scarlett Kim, Cyan DeVeaux, Yujie Tao, Tara Srirangarajan, Jeremy Bailenson

  • Open Access

    Translation Effectiveness of Offset Heart Rate Biofeedback as a Mindless Intervention for Alcohol Craving Among Risky Drinkers: Controlled Experiment

    by Yiran Zhao, Jatin Arora, Yujie Tao, Dave B Miller, Alexander T Adams, Tanzeem Choudhury

    Background: Digital and wearable intervention systems promise to improve how people manage their behavioral health conditions by making interventions available when the user can best benefit from them. However, existing interventions are obtrusive because they require attention and motivation to engage in, limiting the effectiveness of such systems in demanding contexts, such as when the user experiences alcohol craving. Mindless interventions, developed by the human-computer interaction community, offer an opportunity to intervene unobtrusively. Offset heart rate biofeedback is an iconic type of mindless intervention powered by entrainment and can mitigate the physiological and psychological response to stressors. Objective: This work aimed to characterize the translational effectiveness of offset heart rate biofeedback on cue-elicit alcohol craving among risky drinkers. Methods: We conducted an out-of-lab, between-group, controlled experiment with 26 participants who performed harmful or hazardous drinking. The control group served as negative control and received no intervention, while the experimental group received offset heart rate biofeedback during alcohol exposure and recovery. We elicited alcohol cravings through a series of alcohol cues, including performing mental imagery, viewing alcohol images, and sniffing alcohol. We measured the physiological response to alcohol (ie, heart rate variability), self-reported craving, and self-reported anxiety. We constructed linear mixed-effects models to understand the effect of intervention during alcohol exposure and alcohol recovery after exposure. Following the linear mixed effect model, we conducted pair-wise comparisons for measures between the control and experimental groups. Results: We found that offset heart rate biofeedback significantly reduced the increase in heart rate variability (P=.01 and P=.052) and self-reported craving (P=.04 and P=.02) in response to alcohol cues. Participants’ anxiety was not affected by either the alcohol cues or the offset heart rate biofeedback. Conclusions: Offset heart rate biofeedback has the potential to immediately and unobtrusively mitigate cue-elicit alcohol craving among risky drinkers. The results of this study opened new opportunities for digital and wearable interventions to mitigate alcohol craving, either as wellness apps for risky drinkers or as digital prescriptions and integration with sensing systems for people with alcohol dependency.


  • Open Access

    Translation Effectiveness of Offset Heart Rate Biofeedback as a Mindless Intervention for Alcohol Craving Among Risky Drinkers: Controlled Experiment (Preprint)

    by Yiran Zhao, Jatin Arora, Yujie Tao, Dave B Miller, Alexander T Adams, Tanzeem Choudhury

    BACKGROUND Digital and wearable intervention systems promise to improve how people manage their behavioral health conditions by making interventions available when the user can best benefit from them. However, existing interventions are obtrusive because they require attention and motivation to engage in, limiting the effectiveness of such systems in demanding contexts, such as when the user experiences alcohol craving. Mindless interventions, developed by the human-computer interaction community, offer an opportunity to intervene unobtrusively. Offset heart rate biofeedback is an iconic type of mindless intervention powered by entrainment and can mitigate the physiological and psychological response to stressors. OBJECTIVE This work aimed to characterize the translational effectiveness of offset heart rate biofeedback on cue-elicit alcohol craving among risky drinkers. METHODS We conducted an out-of-lab, between-group, controlled experiment with 26 participants who performed harmful or hazardous drinking. The control group served as negative control and received no intervention, while the experimental group received offset heart rate biofeedback during alcohol exposure and recovery. We elicited alcohol cravings through a series of alcohol cues, including performing mental imagery, viewing alcohol images, and sniffing alcohol. We measured the physiological response to alcohol (ie, heart rate variability), self-reported craving, and self-reported anxiety. We constructed linear mixed-effects models to understand the effect of intervention during alcohol exposure and alcohol recovery after exposure. Following the linear mixed effect model, we conducted pair-wise comparisons for measures between the control and experimental groups. RESULTS We found that offset heart rate biofeedback significantly reduced the increase in heart rate variability (P=.01 and P=.052) and self-reported craving (P=.04 and P=.02) in response to alcohol cues. Participants’ anxiety was not affected by either the alcohol cues or the offset heart rate biofeedback. CONCLUSIONS Offset heart rate biofeedback has the potential to immediately and unobtrusively mitigate cue-elicit alcohol craving among risky drinkers. The results of this study opened new opportunities for digital and wearable interventions to mitigate alcohol craving, either as wellness apps for risky drinkers or as digital prescriptions and integration with sensing systems for people with alcohol dependency.


  • Open Access

    Embodying Physics-Aware Avatars in Virtual Reality

    by Yujie Tao, Cheng Yao Wang, Andrew D Wilson, Eyal Ofek, Mar Gonzalez-Franco

    Embodiment toward an avatar in virtual reality (VR) is generally stronger when there is a high degree of alignment between the user’s and self-avatar’s motion. However, one-to-one mapping between the two is not always ideal when user interacts with the virtual environment. On these occasions, the user input often leads to unnatural behavior without physical realism (e.g., objects penetrating virtual body, body unmoved by hitting stimuli). We investigate how adding physics correction to self-avatar motion impacts embodiment. Physics-aware self-avatar preserves the physical meaning of the movement but introduces discrepancies between the user’s and self-avatar’s motion, whose contingency is a determining factor for embodiment. To understand its impact, we conducted an in-lab study (n = 20) where participants interacted with obstacles on their upper bodies in VR with and without physics correction. Our results showed that, rather than compromising embodiment level, physics-responsive self-avatar improved embodiment compared to no-physics condition in both active and passive interactions.


  • Open Access

    Affective Touch as Immediate and Passive Wearable Intervention

    by Yiran Zhao, Yujie Tao, Grace Le, Rui Maki, Alexander Adams, Pedro Lopes, Tanzeem Choudhury

    We investigated affective touch as a new pathway to passively mitigate in-the-moment anxiety. While existing mobile interventions offer great promises for health and well-being, they typically focus on achieving long-term effects such as shifting behaviors. As such, most mobile interventions are not applicable to provide immediate help in acute conditions -- when a user experiences a high anxiety level during ongoing events (e.g., completing high-stake tasks or mitigating interpersonal conflicts). A few works have developed passive interventions that are effective in-the-moment by leveraging breathing regulations and biofeedback. In this paper, we drew on neuroscientific findings on affective touch, the slow stroking on hairy skin that can elicit innate pleasantness and evaluated affective touch as a mobile health intervention. To induce affective touch, we first engineered a wearable device that renders a soft stroking sensation on the user's forearm. Then, we conducted a between-group experiment, in which participants underwent high-stress situations with/without receiving affective touch and post-experiment interviews, with 24 participants. Our results showed that participants who received affective touch experienced lower state anxiety and the same physiological stress response level compared to the control group participants. We also found that affective touch facilitated emotion regulation by rendering pleasantness, providing emotional support, and shifting attention. Finally, we discussed the immediate effect of affective touch on anxiety and physiological stress, the benefits of affective touch as a passive intervention, and the implementation considerations to use affective touch in just-in-time systems.