Abstract
MediaPipe’s 52 facial blendshape coefficients have become the de facto representationfor real-time facial analysis and avatar animation, yet their suitability for continuousmicro-expression (ME) spotting remains unknown. We present the first systematicevaluation of ME spotting in the blendshape domain through a representationevaluation framework comprising a training-free, fully invertible vertex–time spectralgraph wavelet transform (VT-SGWT), matched filtering, controlled validation, and anoracle-derived representational upper bound. The proposed framework achieves an ME-onlyF1-score of 5.13%, while the oracle attains an AUC of only 0.691 despite perfecttemporal localization. Together, these analyses consistently indicate that the observedperformance ceiling arises from the limited discriminative information preserved by thestandardized 52-dimensional blendshape representation rather than from the spottingalgorithm itself. The findings establish the representational limits of deployment-orientedblendshape representations for continuous micro-expression spotting andprovide a principled framework for evaluating standardized facial representations fordownstream affective computing applications.

This publication has 14 references indexed in Scilit: