Intensifying Emotional Reactions via Tactile Gestures in Immersive Films
Authors:
Open Access
- 28 June 2017
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 13 (3) , 1-17
Abstract
The film industry continuously strives to make visitors’ movie experience more immersive and thus, more captivating. This is realized through larger screens, sophisticated speaker systems, and high quality 2D and 3D content. Moreover, a recent trend in the film industry is to incorporate multiple interaction modalities, such as 4D film, to simulate rain, wind, vibration, and heat, in order to intensify viewers’ emotional reactions. In this context, humans’ sense of touch possesses significant potential for intensifying emotional reactions for the film experience beyond audio-visual sensory modalities. This article presents a framework for authoring tactile cues (tactile gestures as used in this article) and enabling automatic rendering of said gestures to intensify emotional reactions in an immersive film experience. To validate the proposed framework, we conducted an experimental study where tactile gestures are designed and evaluated for the ability to intensify four emotional reactions: high valence-high arousal, high valence-low arousal, low valence-high arousal, and low valence-low arousal. Using a haptic jacket, participants felt tactile gestures that are synchronized with the audio-visual contents of a film. Results demonstrated that (1) any tactile feedback generated a positive user experience; (2) the tactile feedback intensifies emotional reactions when the audio-visual stimuli elicit clear emotional responses, except for low arousal emotional response since tactile gestures seem to always generate excitement; (3) purposed tactile gestures do not seem to significantly outperform randomized tactile gesture for intensifying specific emotional reactions; and (4) using a haptic jacket is not distracting for the users.Keywords
This publication has 21 references indexed in Scilit:
- Feel EffectsACM Transactions on Applied Perception, 2014
- Bodily maps of emotionsProceedings of the National Academy of Sciences, 2013
- Design and development of a user centric affective haptic jacketMultimedia Tools and Applications, 2013
- Human emotion recognition from videos using spatio-temporal and audio featuresThe Visual Computer, 2012
- Effect of kinesthetic and tactile haptic feedback on the quality of experience of edutainment applicationsMultimedia Tools and Applications, 2012
- Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion researchersCognition and Emotion, 2010
- The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathologyDevelopment and Psychopathology, 2005
- The Role of Haptics in Immersive Telecommunication EnvironmentsIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Measuring Presence in Virtual Environments: A Presence QuestionnairePRESENCE: Virtual and Augmented Reality, 1998
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994