An Ensemble Method for Classifying Startle Eyeblink Modulation from High-Speed Video Records
- 10 December 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 2 (1) , 50-63
Abstract
Psychophysiological measurements of startle eyeblink can provide information about the state of an individual regarding sensory, attentional, cognitive, and affective processing, and thus reveal valences of interest for affective computing. However, eyeblink is usually measured using intrusive contact electromyographic (EMG) electrodes, accompanied by a laborious manual process of feature extraction. We introduce a new noninvasive automatic system using high-speed video recording of startle blinks in conjunction with data-driven feature selection and support vector machine (SVM) ensembles to classify startle eyeblinks. Using a prestimulus (prepulse) to produce robust modulation of acoustically elicited startle eyeblinks, we tracked the blinks using 250 frames per second video, and extracted different features from eyelid displacement and velocity signals. The SVMs were able to determine whether a trial had contained startle or prepulse+startle stimuli with an accuracy of up to 73 percent (five-fold cross validation). By fusing the decisions made on different feature sets, an ensemble of seven SVMs increased this rate to almost 79 percent. Since startle eyeblinks are robustly modulated by not only sensory events (such as the prepulse used in this study) but also affective and cognitive states, eyelid tracking using high-speed video, in conjunction with the introduced classification method, is an effective and user-friendly alternative to EMG for classification of startle blinks to infer users' affective-cognitive states.Keywords
This publication has 65 references indexed in Scilit:
- The time of the crime: Cognitively induced tonic arousal suppression when lying in a free recall contextActa Psychologica, 2008
- The self in conflict: The role of executive processes during truthful and deceptive responses about attitudesNeuroImage, 2008
- Incremental wrapper-based gene selection from microarray data for cancer classificationPattern Recognition, 2006
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Application of the GA/KNN method to SELDI proteomics dataBioinformatics, 2004
- 10.1162/153244303322753616Applied Physics Letters, 2000
- Statistical pattern recognition: a reviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Feature selection: evaluation, application, and small sample performanceIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Floating search methods in feature selectionPattern Recognition Letters, 1994
- Emotional learning, hedonic change, and the startle probe.Journal of Abnormal Psychology, 1993