DeepSpace: Mood-Based Image Texture Generation for Virtual Reality from Music
Authors:
- Misha SraMSMisha Sra
- Prashanth VijayaraghavanPVPrashanth Vijayaraghavan
- Ognjen RudovicOROgnjen Rudovic
- Pattie MaesPMPattie Maes
- Deb RoyDRDeb Roy
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2289-2298
Abstract
Affective virtual spaces are of interest for many VR applications in areas of wellbeing, art, education, and entertainment. Creating content for virtual environments is a laborious task involving multiple skills like 3D modeling, texturing, animation, lighting, and programming. One way to facilitate content creation is to automate sub-processes like assignment of textures and materials within virtual environments. To this end, we introduce the DeepSpace approach that automatically creates and applies image textures to objects in procedurally created 3D scenes. The main novelty of our DeepSpace approach is that it uses music to automatically create kaleidoscopic textures for virtual environments designed to elicit emotional responses in users. Specifically, DeepSpace exploits the modeling power of deep neural networks, which have shown great performance in image generation tasks, to achieve mood-based image generation. Our study results indicate the virtual environments created by DeepSpace elicit positive emotions and achieve high presence scores.Keywords
This publication has 29 references indexed in Scilit:
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Automatic semantic modeling of indoor scenes from low-quality RGB-D data using contextual informationACM Transactions on Graphics, 2014
- Glove: Global Vectors for Word Representation2014
- Deep belief networksScholarpedia, 2009
- Emotions evoked by the sound of music: Characterization, classification, and measurement.Emotion, 2008
- Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday ListeningJournal of New Music Research, 2004
- Core affect and the psychological construction of emotion.Psychological Review, 2003
- Measuring Presence in Virtual Environments: A Presence QuestionnairePRESENCE: Virtual and Augmented Reality, 1998
- A genetic algorithm tutorialStatistics and Computing, 1994
- Connectionist learning of belief networksArtificial Intelligence, 1992