Classification of Emotional and Immersive Outcomes in the Context of Virtual Reality Scene Interactions
Open Access
- 13 November 2023
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 13 (22) , 3437
Abstract
The constantly evolving technological landscape of the Metaverse has introduced a significant concern: cybersickness (CS). There is growing academic interest in detecting and mitigating these adverse effects within virtual environments (VEs). However, the development of effective methodologies in this field has been hindered by the lack of sufficient benchmark datasets. In pursuit of this objective, we meticulously compiled a comprehensive dataset by analyzing the impact of virtual reality (VR) environments on CS, immersion levels, and EEG-based emotion estimation. Our dataset encompasses both implicit and explicit measurements. Implicit measurements focus on brain signals, while explicit measurements are based on participant questionnaires. These measurements were used to collect data on the extent of cybersickness experienced by participants in VEs. Using statistical methods, we conducted a comparative analysis of CS levels in VEs tailored for specific tasks and their immersion factors. Our findings revealed statistically significant differences between VEs, highlighting crucial factors influencing participant engagement, engrossment, and immersion. Additionally, our study achieved a remarkable classification performance of 96.25% in distinguishing brain oscillations associated with VR scenes using the multi-instance learning method and 95.63% in predicting emotions within the valence-arousal space with four labels. The dataset presented in this study holds great promise for objectively evaluating CS in VR contexts, differentiating between VEs, and providing valuable insights for future research endeavors.Keywords
Funding Information
- Erzurum Teknik Üniversitesi (2021/012)
This publication has 70 references indexed in Scilit:
- Functional magnetic resonance imaging during emotion recognition in social anxiety disorder: an activation likelihood meta-analysisFrontiers in Human Neuroscience, 2013
- The MPI Facial Expression Database — A Validated Database of Emotional and Conversational Facial ExpressionsPLOS ONE, 2012
- Survey on speech emotion recognition: Features, classification schemes, and databasesPattern Recognition, 2011
- Spatial and temporal EEG dynamics of motion sicknessNeuroImage, 2010
- Learner immersion engagement in the 3D virtual world: principles emerging from the DELVE projectInnovation in Teaching and Learning in Information and Computer Sciences, 2009
- A Review of Presence and Performance in Virtual EnvironmentsInternational Journal of Human–Computer Interaction, 2000
- A Conceptual Model of the Sense of Presence in Virtual EnvironmentsPRESENCE: Virtual and Augmented Reality, 1999
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994
- Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator SicknessThe International Journal of Aviation Psychology, 1993
- An Index of Factorial SimplicityPsychometrika, 1974