Partitioned Region-focused and Graph Convolution Hybrid Network for Macro- and Micro-expression Spotting
Preprint
- 10 May 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
Recently, the analysis of facial macro- and micro-expressions has attracted the attention of researchers. However, spotting micro-expressions in long video sequences is a significant challenge due to their subtle and transient nature, which makes it difficult for current methods to pinpoint the precise time intervals of these fleeting expressions accurately. To address this issue, we propose the hybrid lightweight, partitioned region-focused and graph convolution network \(\text{(PRF-GCN)}\). The proposed model incorporates a partitioned region-focused convolutional approach that aligns feature extraction with regions of interest based on human attention mechanisms, to capture fine-grained motion cues effectively. The extracted features are then transformed into graph structures to facilitate relational modeling and reasoning through GCNs. By predicting the probability that each frame belongs to a micro-expression interval, the proposed framework offers enhanced temporal localization capabilities. Experimental results obtained on the \(\text{CAS(ME)}^2\) and \(\text{SAMM-LV}\) datasets demonstrate strong performance, with F1-scores of 0.2124 and 0.1733, respectively. In addition, extensive ablation studies further confirm the effectiveness of the proposed \(\text{PRF-GCN}\).
Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- Duration-aware and mode-aware micro-expression spotting for long video sequencesSignal Processing: Image Communication, 2024
- Micro-expression spotting with a novel wavelet convolution magnification network in long videosPattern Recognition Letters, 2024
- Micro-expression spotting with multi-scale local transformer in long videosPattern Recognition Letters, 2023
- Spot-then-Recognize: A Micro-Expression Analysis Network for Seamless Evaluation of Long VideosSignal Processing: Image Communication, 2022
- Spatio-temporal convolutional emotional attention network for spotting macro- and micro-expression intervals in long video sequencesPattern Recognition Letters, 2022
- Evaluation of the Spatio-Temporal Features and GAN for Micro-Expression Recognition SystemJournal of Signal Processing Systems, 2020
- CBAM: Convolutional Block Attention Module2018
- Study of Facial Micro-expressions in Psychology2014
- How Fast are the Leaked Facial Expressions: The Duration of Micro-ExpressionsJournal of Nonverbal Behavior, 2013
- Gabor filter-based edge detectionPattern Recognition, 1992