Understanding the Effects of Interaction on Emotional Experiences in VR

Authors:
  • ZKZheyuan Kuang
    Zheyuan Kuang
  • TLTinghui Li
    Tinghui Li
  • WJWeiwei Jiang
    Weiwei Jiang
  • SMSven Mayer
    Sven Mayer
  • FSFlora Salim
    Flora Salim
  • BTBenjamin Tag
    Benjamin Tag
  • AWAnusha Withana
    Anusha Withana
  • ZSZhanna Sarsenbayeva
    Zhanna Sarsenbayeva

Abstract
Virtual reality has been effectively used for eliciting emotions, yet most research focuses on the intensity of affective responses rather than on how interaction influences those experiences. To address this gap, we advance a validated VR emotion-elicitation dataset through two key extensions. First, we add a new high-arousal, high-valence scene and validate its effectiveness in a within-subject study (N=24). Second, we incorporate interactive elements into each scene, creating both interactive and non-interactive versions to examine the impact of interaction on emotional responses. We evaluate interaction through a multimodal approach combining subjective ratings and physiological signals to capture both conscious and unconscious affective responses. Our evaluation study (N=84) shows that interaction not only amplifies emotions but modulates them in context, supporting coping in negative scenes and enhancing enjoyment in positive scenes. These findings highlight the potential of scene-tailored interaction for different applications, where regulating emotions is as important as eliciting them.
All Related Versions