Fostering Emotional Perspective-Taking: An Exploration of Affective Face-Tracking Interactions in the VR Narrative Rekindle
Open Access
- 12 June 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 656-660
Abstract
Interest in leveraging emotions in Interactive Digital Narrative (IDN) has been growing, and Virtual Reality (VR) offers rich access to real-time biometric data such as facial expressions; yet this capability remains underexplored in novel IDN design. Existing approaches typically treat emotion input superficially, such as adjusting system difficulty or aesthetics, but rarely influence how players experience the narrative itself. Prior work also lacks a focus on a specific authored narrative. We propose an experimental affective interaction model that uses a VR headset’s built-in face-tracking capability to recognize player emotional states, fostering “emotional perspective-taking” between the player and their embodied story character, thereby deepening the player’s emotional connection to the character and their narrative engagement with the VR experience.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- The Cognitive Structure of Emotions2022
- Perceived Agency as Meaningful Expression of Playable Character Personality Traits in Storygames2018
- Fear as a biofeedback game mechanic in virtual reality2018
- Compound facial expressions of emotionProceedings of the National Academy of Sciences, 2014
- Exploring passive user interaction for adaptive narratives2012
- Agency and the Art of Interactive Digital StorytellingLecture Notes in Computer Science, 2010
- Affective Interactive Narrative in the CALLAS Project2007
- Expressive Behaviors for Virtual Worlds2004
- Interactive Pedagogical Drama: Carmen’s Bright IDEAS AssessedLecture Notes in Computer Science, 2003
- Facial Action Coding System1978