LiveProbe: Exploring Continuous Voice Liveness Detection via Phonemic Energy Response Patterns
- 13 December 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (8) , 7215-7228
Abstract
Voice assistants support contactless smart device control and thus act as a holy grail of human–computer interaction. However, recent studies reveal that an adversary can manipulate devices by vicious voice commands. This security risk is caused by only executing one-time liveness detection and lacking safeguard modules after service activation. Therefore, identifying speaker type (i.e., human articulators or loudspeakers) is critical in protecting voice-driven services during an entire interaction session. In this article, we propose a continuous voice liveness detection approach LiveProbe, leveraging unique energy response patterns in frequency bands induced by distinct voice generation mechanisms. The rationality behind LiveProbe is presented in two aspects: human articulator reshapes initial voices by exquisitely coordinated movements of vocal organs, which act as band-pass filters generating unique energy responses; nevertheless, the internal modules of loudspeakers are position fixed and cannot reproduce this response characteristic. To that end, we first work on voice generation mechanisms behind two-type speakers that cause spectrum differences. Then, we elaborately construct signal processing and deep-learning modules to extract liveness features. Especially, our approach does not interfere with normal voice interaction and need not to carry customized sensors. The experiment presents its effectiveness against potential attacks with a false acceptance rate of 0.51%.Keywords
Funding Information
- National Natural Science Foundation of China (U20A20181, 61732017, 61902060, 61902122)
- China Scholarship Council
- Open Research Fund from Guangdong Laboratory of Artificial Intelligence and Digital Economy (GML-KF-22-23)
- National Social Science Foundation of China (19ZDA103)
This publication has 39 references indexed in Scilit:
- You Can Hear But You Cannot Steal: Defending Against Voice Impersonation Attacks on Smartphones2017
- VoiceLive2016
- Biometric Liveness Detection: Challenges and Research OpportunitiesIEEE Security & Privacy, 2015
- Advances in natural language processingScience, 2015
- Learning dynamic features with neural networks for phoneme recognition2014
- Principal component analysisWIREs Computational Statistics, 2010
- Locality-sensitive hashing scheme based on p-stable distributions2004
- Fast force-generation dynamics of human articulatory musclesJournal of Applied Physiology, 2004
- Wavelet Methods for Time SeriesAnalysis2000
- Fast algorithms for discrete and continuous wavelet transformsIEEE Transactions on Information Theory, 1992