F. X. Erick
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
F. X. Erick has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Nina Holzer
Fraunhofer Institute for Integrated Circuits IIS, Germany
1 shared publication - Pulkit Arora
Fraunhofer Institute for Integrated Circuits IIS, Germany
1 shared publication - Shrutika S. Sawant
School of Information Technology & Engineering, Vellore Institute of Technology, Vellore, India
1 shared publication - Theresa Ida Götz
Fraunhofer IIS, Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany
1 shared publication
Latest Publications
- Open Access
- 21 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Self-supervised representation learning using multimodal Transformer for emotion recognition
In this paper, we present a Modality-Agnostic Transformer based Self-Supervised Learning (MATS2L) for emotion recognition using physiological signals. The proposed approach consists of two stages: a) Pretext stage, where the transformer model is pre-trained with unlabeled physiological signal data using masked signal prediction as pre-training task and form contextualized signal representations. b) Downstream stage, where self-supervised learning (SSL) representations extracted from a pre-trained model are utilized for emotion recognition tasks. Modality-agnostic approach allows the transformer model to focus on exploring mutual features among different physiological signals and learning more meaningful embeddings to estimate emotions effectively. We conduct several experiments on a public dataset WESAD and perform comparisons with fully supervised and other competitive SSL approaches. Experimental results showed that the proposed approach is capable of learning meaningful features and superior to other competitive SSL approaches. Moreover, a transformer model trained on SSL features outperforms fully supervised transformer model. We also present detailed ablation studies to prove the robustness of our approach.
- 21 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessSelf-supervised representation learning using multimodal Transformer for emotion recognition
In this paper, we present a Modality-Agnostic Transformer based Self-Supervised Learning (MATS2L) for emotion recognition using physiological signals. The proposed approach consists of two stages: a) Pretext stage, where the transformer model is pre-trained with unlabeled physiological signal data using masked signal prediction as pre-training task and form contextualized signal representations. b) Downstream stage, where self-supervised learning (SSL) representations extracted from a pre-trained model are utilized for emotion recognition tasks. Modality-agnostic approach allows the transformer model to focus on exploring mutual features among different physiological signals and learning more meaningful embeddings to estimate emotions effectively. We conduct several experiments on a public dataset WESAD and perform comparisons with fully supervised and other competitive SSL approaches. Experimental results showed that the proposed approach is capable of learning meaningful features and superior to other competitive SSL approaches. Moreover, a transformer model trained on SSL features outperforms fully supervised transformer model. We also present detailed ablation studies to prove the robustness of our approach.