Synergistic Spotting and Recognition of Micro-Expression via Temporal State Transition
Authors:
- 6 April 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Micro-expressions are involuntary facial movements that cannot be consciously controlled, conveying subtle cues with substantial real-world applications. The analysis of micro-expressions generally involves two main tasks: spotting micro-expression intervals in long videos and recognizing the emotions associated with these intervals. Previous deep-learning methods have primarily relied on classification networks utilizing sliding windows. However, fixed window sizes and window-level hard classification introduce numerous constraints. Additionally, these methods have not fully exploited the potential of complementary pathways for spotting and recognition. In this paper, we present a novel temporal state transition architecture grounded in the state space model, which replaces conventional window-level classification with video-level regression. Furthermore, by leveraging the inherent connections between spotting and recognition tasks, we propose a synergistic strategy that enhances overall analysis performance. Extensive experiments demonstrate that our method achieves state-of-the-art performance. The codes are available at https://github.com/zizheng-guo/ME-TST.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China
- National Science and Technology Major Project
This publication has 27 references indexed in Scilit:
- VideoMamba: State Space Model for Efficient Video Understanding2024
- SFAMNet: A scene flow attention-based micro-expression networkNeurocomputing, 2023
- Micron-BERT: BERT-Based Facial Micro-Expression Recognition2023
- Spot-then-Recognize: A Micro-Expression Analysis Network for Seamless Evaluation of Long VideosSignal Processing: Image Communication, 2022
- SAMM Long Videos: A Spontaneous Facial Micro- and Macro-Expressions Dataset2020
- MEGC 2019 – The Second Facial Micro-Expressions Grand Challenge2019
- Shallow Triple Stream Three-dimensional CNN (STSTNet) for Micro-expression Recognition2019
- Spotting Micro-Expressions on Long Videos Sequences2019
- Automatic Micro-expression Recognition from Long Video Using a Single Spotted Apex2017
- Two-Frame Motion Estimation Based on Polynomial Expansion2003