VFD-Net: Vocoder Fingerprints Detection for Fake Audio
Authors:
- 14 April 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 12151-12155
Abstract
With the rapid development of audio deepfake technology, the credibility and authenticity of public opinion is facing a formidable challenge. Since vocoder is the key component of audio deepfake and leaves distinctive fingerprint features, we propose VFD-Net (Vocoder Fingerprints Detection Net), a new vocoder architectures attribution scheme, which is based on patch-wise supervised contrastive learning (PCL) to capture the global consistency of the vocoder fingerprints and to improve the detection performance in cross-set testing and audio compression scenario. PCL brings patches belonging to the same vocoder class closer together in the representation space, while pushing patches from different vocoder classes further apart. Comparative experimental results show that the average accuracy of our proposed outperforms state-of-the-art 30%-45% under cross-set testing and AAC compression circumstances. Furthermore, our proposed approach achieves a 83.67% average accuracy in short-term fake audio detection within one second. It can be used to detect partially fake audio by analyzing the consistency of vocoder fingerprints.Keywords
This publication has 20 references indexed in Scilit:
- AASIST: Audio Anti-Spoofing Using Integrated Spectro-Temporal Graph Attention Networks2022
- Rawboost: A Raw Data Boosting and Augmentation Method Applied to Automatic Speaker Verification Anti-Spoofing2022
- StyleMelGAN: An Efficient High-Fidelity Adversarial Vocoder with Temporal Adaptive Normalization2021
- End-to-End anti-spoofing with RawNet22021
- Parallel Wavegan: A Fast Waveform Generation Model Based on Generative Adversarial Networks with Multi-Resolution Spectrogram2020
- Waveglow: A Flow-based Generative Network for Speech Synthesis2019
- Squeeze-and-Excitation Networks2018
- Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics2018
- Constant Q cepstral coefficients: A spoofing countermeasure for automatic speaker verificationComputer Speech & Language, 2017
- Deep Residual Learning for Image Recognition2016