Selection of Significant Brain Regions Based on MvGTDA and TS-DLF for Emotion Estimation
Open Access
- 15 June 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 6, 32481-32492
Abstract
In this paper, we propose a novel method for estimating human emotion using functional brain images. The final goal of our study is contribution to affective brain computer interfaces (aBCIs), which use neuropsychological signals. In the proposed method, we newly derive multiview general tensor discriminant analysis (MvGTDA) in order to reveal significant brain regions and accurately estimate human emotion evoked by visual stimuli. This is because it is important to find activation of multiple brain regions for estimating emotional states. Since we regard a “Brodmann area”as a “view”and introduce L 1 -norm regularization for these views, MvGTDA can eliminate non-crucial Brodmann areas and select significant ones. Moreover, in general studies on functional brain images based on machine learning methodologies, there is an overfitting problem caused by a small sample size. Therefore, revealing significant Brodmann areas based on MvGTDA has another important role, i.e., solving the overfitting problem. By inputting estimation results respectively obtained from the significant areas and the MvGTDA-based feature, tensor-based supervised decision-level fusion (TS-DLF) integrates them and outputs the final estimation result of the user's emotion. In experiments, we showed the effectiveness of our method by using actual functional brain images and we revealed the significant brain regions in emotional states.Keywords
This publication has 55 references indexed in Scilit:
- A survey of multilinear subspace learning for tensor dataPattern Recognition, 2011
- Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significanceNature Reviews Neuroscience, 2010
- A hierarchical positive and negative emotion understanding system based on integrated analysis of visual and brain signalsNeurocomputing, 2010
- Sparse logistic regression for whole-brain classification of fMRI dataNeuroImage, 2010
- Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patternsNeuroImage, 2008
- Beyond mind-reading: multi-voxel pattern analysis of fMRI dataTrends in Cognitive Sciences, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Neural structures associated with recognition of facial expressions of basic emotionsProceedings Of The Royal Society B-Biological Sciences, 1998
- Support-vector networksMachine Learning, 1995
- On a Test of Whether one of Two Random Variables is Stochastically Larger than the OtherThe Annals of Mathematical Statistics, 1947