The Effects of Visual-Olfactory Interactions With Moving Particles on EEG-Based Emotional Classification in AR Environments
- 8 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. PP (10772626) , 1-13
Abstract
Cross-modal perception, the integration of information from multiple senses, plays a critical role in shaping emotional experiences. This study examines the interactions between visual and olfactory stimuli and their effects on emotional responses, a topic rarely addressed in prior research. Experiments employed five distinct visual stimulation methods that were combined with olfactory stimuli. Participants' emotional responses were assessed via surveys and electroencephalography (EEG) signal analysis. The study varied the color and movement direction of augmented particles to investigate their impact on EEG signals and emotional states. The findings demonstrated significant differences in emotional state classification under the influence of visual-olfactory interactions. Specifically, with backward-moving particles with matching colors (M4), classification accuracy was comparable to that of unimodal olfactory conditions (M1). Other visual stimuli generally caused confusion in classifying emotional responses. The increased valence ratings for pleasant aromas across all visual conditions did not consistently align with EEG-based classification results, suggesting that visual stimuli may introduce complexities into neural signals. These results highlight the intricate dynamics of multisensory interactions, emphasizing the role of visual stimuli in modulating emotional responses. The findings also suggest the potential of visual-olfactory interactions in developing augmented reality (AR) systems. By aligning visual and olfactory cues, AR environments can enhance the user experience and create immersive emotional landscapes, leading to applications for mood modulation and stress relief. This study underscores the relevance of multisensory integration in advancing emotion analysis and affective computing.Keywords
Funding Information
- Basic Science Research Program
- National Research Foundation of Korea
- Ministry of Education (RS-2024-00334159)
- Global Joint Research Program funded by Pukyong National University (202412340001)
This publication has 63 references indexed in Scilit:
- Investigation of color‐emotion associations of the university studentsColor Research & Application, 2020
- Emotion detection from EEG recordings based on supervised and unsupervised dimension reductionConcurrency and Computation: Practice and Experience, 2018
- Correspondence analysis of color–emotion associationsColor Research & Application, 2017
- Wavelet-based emotion recognition system using EEG signalNeural Computing and Applications, 2016
- Color–Odor Interactions: A Review and ModelChemosensory Perception, 2013
- Visual Pathway2012
- Modifications of EEG Related to Directed Perception and Analysis of Olfactory Information in HumansNeurophysiology, 2009
- Identification of unpleasant odors is independent of ageArchives of Clinical Neuropsychology, 2006
- Neuroimaging of multisensory processing in vision, audition, touch, and olfactionCognitive Processing, 2004
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994