On the Representation Limits of Facial Blendshapes for Micro-Expression Spotting
Authors:
- Suraj SundaramSSSuraj Sundaram
- Manish NarwariaMNManish Narwaria
Preprint
- 1 September 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
MediaPipe’s 52 facial blendshape coefficients have become the de facto representationfor real-time facial analysis and avatar animation, yet their suitability for continuousmicro-expression (ME) spotting remains unknown. We present the first systematicevaluation of ME spotting in the blendshape domain through a representationevaluation framework comprising a training-free, fully invertible vertex–time spectralgraph wavelet transform (VT-SGWT), matched filtering, controlled validation, and anoracle-derived representational upper bound. The proposed framework achieves an ME-onlyF1-score of 5.13%, while the oracle attains an AUC of only 0.691 despite perfecttemporal localization. Together, these analyses consistently indicate that the observedperformance ceiling arises from the limited discriminative information preserved by thestandardized 52-dimensional blendshape representation rather than from the spottingalgorithm itself. The findings establish the representational limits of deployment-orientedblendshape representations for continuous micro-expression spotting andprovide a principled framework for evaluating standardized facial representations fordownstream affective computing applications.Keywords
This publication has 14 references indexed in Scilit:
- Causal-Ex: Causal graph-based micro and macro expression spottingPattern Recognition Letters, 2025
- Ofct: a micro-expression spotting method fusing optical flow features and category text informationComplex & Intelligent Systems, 2025
- Micro-expression spotting with a novel wavelet convolution magnification network in long videosPattern Recognition Letters, 2024
- Deep Learning for Micro-Expression Recognition: A SurveyIEEE Transactions on Affective Computing, 2022
- Micro-expression spotting based on optical flow featuresPattern Recognition Letters, 2022
- A Time-Vertex Signal Processing Framework: Scalable Processing and Meaningful Representations for Time-Series on GraphsIEEE Transactions on Signal Processing, 2017
- A main directional maximal difference analysis for spotting facial movements from long-term videosNeurocomputing, 2017
- CAS(ME): A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and RecognitionIEEE Transactions on Affective Computing, 2017
- Wavelets on graphs via spectral graph theoryApplied and Computational Harmonic Analysis, 2011
- An introduction to ROC analysisPattern Recognition Letters, 2006