Multimodal consumer choice prediction using EEG signals and eye tracking
Authors:
Open Access
- 8 January 2025
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Computational Neuroscience
- Vol. 18, 1516440
Abstract
Marketing plays a vital role in the success of a business, driving customer engagement, brand recognition, and revenue growth. Neuromarketing adds depth to this by employing insights into consumer behavior through brain activity and emotional responses to create more effective marketing strategies. Electroencephalogram (EEG) has typically been utilized by researchers for neuromarketing, whereas Eye Tracking (ET) has remained unexplored. To address this gap, we propose a novel multimodal approach to predict consumer choices by integrating EEG and ET data. Noise from EEG signals is mitigated using a bandpass filter, Artifact Subspace Reconstruction (ASR), and Fast Orthogonal Regression for Classification and Estimation (FORCE). Class imbalance is handled by employing the Synthetic Minority Over-sampling Technique (SMOTE). Handcrafted features, including statistical and wavelet features, and automated features from Convolutional Neural Network and Long Short-Term Memory (CNN-LSTM), have been extracted and concatenated to generate a feature space representation. For ET data, preprocessing involved interpolation, gaze plots, and SMOTE, followed by feature extraction using LeNet-5 and handcrafted features like fixations and saccades. Multimodal feature space representation was generated by performing feature-level fusion for EEG and ET, which was later fed into a meta-learner-based ensemble classifier with three base classifiers, including Random Forest, Extended Gradient Boosting, and Gradient Boosting, and Random Forest as the meta-classifier, to perform classification between buy vs. not buy. The performance of the proposed approach is evaluated using a variety of performance metrics, including accuracy, precision, recall, and F1 score. Our model demonstrated superior performance compared to competitors by achieving 84.01% accuracy in predicting consumer choices and 83% precision in identifying positive consumer preferences.Keywords
This publication has 32 references indexed in Scilit:
- Intelligent neuromarketing framework for consumers' preference prediction from electroencephalography signals and eye trackingJournal of Consumer Behaviour, 2023
- Machines learn neuromarketing: Improving preference prediction from self-reports using multiple EEG measures and machine learningInternational Journal of Research in Marketing, 2021
- Fusion of EEG response and sentiment analysis of products review to predict customer satisfactionInformation Fusion, 2019
- Do isolated packaging variables influence consumers' attention and preferences?Physiology & Behavior, 2019
- Combining eye tracking, pupil dilation and EEG analysis for predicting web users click intentionInformation Fusion, 2017
- Analysis of EEG signals and its application to neuromarketingMultimedia Tools and Applications, 2017
- Consumer neuroscience: Assessing the brain response to marketing stimuli using electroencephalogram (EEG) and eye trackingExpert Systems with Applications, 2013
- Random ForestsMachine Learning, 2001
- Stacked generalizationNeural Networks, 1992
- Cerebral location of international 10–20 system electrode placementElectroencephalography and Clinical Neurophysiology, 1987