Effective Multivariate Voice Liveness Detection System for Internet of Things Security
- 1 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Networking
- Vol. 33 (4) , 1916-1929
Abstract
Voice assistants, as crucial components of the Internet of Things (IoT), are vulnerable to voice spoofing attacks and pose great threats to the security of IoT. Passive liveness detection distinguishes between genuine and spoofing voices by analyzing the collected voice, eliminating the need for deploying additional sensors. This method plays a crucial role in detecting spoofing speeches and ensuring the security of the IoT. However, current passive liveness detection methods typically require users to adopt specific gestures. Meanwhile, these methods are often designed for specific attacks and cannot accommodate multivariate attacks. To address these challenges, this paper proposes an efficient and robust liveness feature called VoiceID, which utilizes the inherent vocal cord vibrations and voiced language to authenticate the collected voice. The VoiceID is defined as the set of maximum magnitude-peak frequency bins in the magnitude spectrum of each frame for voice. VoiceID can be combined with existing acoustic features to compensate for the granularity gap in extracting fine-grained features and distinguishing between genuine and spoofing voices. Furthermore, to leverage VoiceID, this paper proposes a solid fake voice liveness detection system named SFSys and elaborates on a series of acoustic features that can work with VoiceID. Extensive experiments on authoritative ASVspoof 2019 and ASVspoof 2021 datasets reveal that VoiceID reduces the equal error rate and the minimum tandem decision cost function of the existing acoustic features by at most 6.19% and 0.2479. Moreover, SFSys outperforms existing voice liveness detection schemes and exhibits robustness in various advanced spoofing attack environments.Keywords
Funding Information
- National Key Research and Development Program of China (2022YFE0138600)
- National Natural Science Foundation of China (U24B20153)
- Hubei Provincial Natural Science Foundation of China (2023AFB998)
- Fundamental Research Funds for the Central Universities, Huazhong University ofScience and Technology (2024JYCXJJ056)
- Shenzhen Science and Technology Program (JCYJ20220530161004009)
- Major Research Project of Hubei Province (2023BAA027)
- Chongqing Natural Science Foundation of China (CSTB2024NSCQMSX0812)
- Scientific and Technological Research Program of Chongqing Municipal Education Commission (KJZDK202401604)
This publication has 33 references indexed in Scilit:
- Leveraging Positional-Related Local-Global Dependency for Synthetic Speech Detection2023
- Improving Robustness of Speech Anti-Spoofing System Using Resnext with Neighbor Filters2022
- Collaborative Sensing in Internet of Things: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2022
- AASIST: Audio Anti-Spoofing Using Integrated Spectro-Temporal Graph Attention Networks2022
- Improved Lightcnn with Attention Modules for Asv Spoofing Detection2021
- End-to-End anti-spoofing with RawNet22021
- Replay and Synthetic Speech Detection with Res2Net Architecture2021
- ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speechComputer Speech & Language, 2020
- VoicePop: A Pop Noise based Anti-spoofing System for Voice Authentication on Smartphones2019
- Librispeech: An ASR corpus based on public domain audio books2015