Mediating individual affective experience through the emotional photo frame
Authors:
- 1 January 2015
- journal article
- research article
- Published by SAGE Publications in Journal of Ambient Intelligence and Smart Environments
- Vol. 7 (1) , 99-113
Abstract
A photograph is considered a medium with emotional legibility and a means of expressing and exchanging emotional experience. This research presents the interactive emotional photo frame system focusing on mediating individual affective experience among close relationships. This emotional photo frame system dynamically controls the photograph based on a user's affective states and user-specified emotion reaction rules. It is designed for helping users recognize and experience the same emotions with others. The system consists of an emotion recognition system, an emotion share server and an emotional digital picture frame. The emotion recognition system analyzes photoplethysmography, skin temperature and galvanic skin response signals to recognize user's emotional states and transmits the results to the server in real-time. The server stores user emotional data with individual emotion reaction rules that define how the picture frame should affect the photo in response to individual affective states. The emotional picture frame renders personalized visual and aural elements on the photograph according to the feedback of emotions. This paper presents an empirical exploration of the effectiveness of this system. The results revealed that most participants were influenced by their partner's emotion presented in this system. There was a strong relation of emotion sharing between the partners.Keywords
This publication has 11 references indexed in Scilit:
- Multimodal Emotion Recognition in Response to VideosIEEE Transactions on Affective Computing, 2011
- Ubiquitous emotion-aware computingPersonal and Ubiquitous Computing, 2011
- A Novel Emotion Elicitation Index Using Frontal Brain Asymmetry for Enhanced EEG-Based Emotion RecognitionIEEE Transactions on Information Technology in Biomedicine, 2011
- Autonomic nervous system activity in emotion: A reviewBiological Psychology, 2010
- On the Classification of Emotional Biosignals Evoked While Viewing Affective Pictures: An Integrated Data-Mining-Based Approach for Healthcare ApplicationsIEEE Transactions on Information Technology in Biomedicine, 2010
- Audio–Visual Affective Expression Recognition Through Multistream Fused HMMIEEE Transactions on Multimedia, 2008
- Recognizing Human Emotional State From Audiovisual SignalsIEEE Transactions on Multimedia, 2008
- Emotion recognition based on physiological changes in music listeningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- DESIGNING EMOTIONAL AWARENESS DEVICES: WHAT ONE SEES IS WHAT ONE FEELSIngeniare. Revista chilena de ingeniería, 2007
- BuddyBeads: techno-jewelry for non-verbal communication within teenager girls groupsPersonal and Ubiquitous Computing, 2005