Spoofing detection via simultaneous verification of audio-visual synchronicity and transcription
- 1 December 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 591-598
Abstract
Acoustic speaker recognition systems are very vulnerable to spoofing attacks via replayed or synthesized utterances. One possible countermeasure is audio-visual speaker recognition. Nevertheless, the addition of the visual stream alone does not prevent spoofing attacks completely and only provides further information to assess the authenticity of the utterance. Many systems consider audio and video modalities independently and can easily be spoofed by imitating only a single modality or by a bimodal replay attack with a victim's photograph or video. Therefore, we propose the simultaneous verification of the data synchronicity and the transcription in a challenge-response setup. We use coupled hidden Markov models (CHMMs) for a text-dependent spoofing detection and introduce new features that provide information about the transcriptions of the utterance and the synchronicity of both streams. We evaluate the features for various spoofing scenarios and show that the combination of the features leads to a more robust recognition, also in comparison to the baseline method. Additionally, by evaluating the data on unseen speakers, we show the spoofing detection to be applicable in speaker-independent use-cases.Keywords
This publication has 16 references indexed in Scilit:
- Text-Dependent Audiovisual Synchrony Detection for Spoofing Detection in Mobile Person Recognition2016
- On the robustness of audiovisual liveness detection to visual speech animation2016
- Audiovisual synchrony assessment for replay attack detection in talking face biometricsMultimedia Tools and Applications, 2015
- Joint Audiovisual Hidden Semi-Markov Model-Based Speech SynthesisIEEE Journal of Selected Topics in Signal Processing, 2013
- Talking-Face Identity Verification, Audiovisual Forgery, and Robustness IssuesEURASIP Journal on Advances in Signal Processing, 2009
- Audio-visual speech asynchrony detection using co-inertia analysis and coupled hidden markov modelsPattern Analysis and Applications, 2008
- Making talking-face authentication robust to deliberate impostureInternational Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2008
- Impostures of Talking Face Systems Using Automatic Face Animation2008
- Audiovisual Speech Synchrony Measure: Application to BiometricsEURASIP Journal on Advances in Signal Processing, 2007
- A coupled HMM for audio-visual speech recognition2002