Robust Detection of Partially Spoofed Audio Using Semantic-Aware Inconsistency Learning
- 3 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech and Language Processing
- Vol. 33, 4590-4603
Abstract
Partially spoofed technology subtly manipulates interested parts in an audio to alter the original meaning, with its fine-grained forgery posing great challenges to existing fully spoofed detection countermeasures. Existing partially spoofed audio detection methods have shown excellent effectiveness in distinguishing clean and long-duration spoofed segments. However, their robustness remains limited when malicious attackers manipulate a finer-grained segment (e.g., only a single phoneme) and employ post-processing operations to reduce detectable discontinuities. To face these challenges, we propose the Semantic-Aware Inconsistency Learning (SAIL) method for robust frame-level detection. It incorporates a robust augmentation module (RAM), a Multi-Scale Semantic Inconsistency Learning (MSIL) module, and a Semantic Separation Module (SSM) to learn robust discriminative features by capturing multi-segment discontinuities and semantic inconsistencies introduced by partially spoofed manipulations. Specifically, the RAM is applied to suppress the model's erroneous attention to additional interference caused by post-processing operations on the subtle spoofed artifacts. Then, the MSIL module is proposed to extract semantic inconsistency features after manipulations, using attention mechanisms at different scales to highlight forgery differences at various granularities. Finally, the SSM is devised to refine these features for robust frame-level detection, utilizing contrastive learning to ensure a clear distinction of inconsistent semantic features in the feature space. Extensive experiments are conducted on three public datasets, including ASVS2019PS, HAD, and LAV-DF, showing that our proposed method achieves the best performance under various noisy scenarios.Keywords
Funding Information
- Funds for the Innovation of Policing Science and Technology, Fujian province (2025Y0068)
- Major Science and Technology Project of Xiamen (3502Z20231007)
This publication has 41 references indexed in Scilit:
- Audio splicing detection and localization using multistage filterbank spectral sketches and decision fusionMultimedia Systems, 2024
- Integrating frame-level boundary detection and deepfake detection for locating manipulated regions in partially spoofed audio forgery attacksComputer Speech & Language, 2023
- Towards Unconstrained Audio Splicing Detection and Localization with Neural Networks2023
- Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization2022
- Partially Fake Audio Detection by Self-Attention-Based Fake Span Discovery2022
- Rawboost: A Raw Data Boosting and Augmentation Method Applied to Automatic Speaker Verification Anti-Spoofing2022
- End-to-End anti-spoofing with RawNet22021
- Long-term high frequency features for synthetic speech detectionDigital Signal Processing, 2020
- Constant Q cepstral coefficients: A spoofing countermeasure for automatic speaker verificationComputer Speech & Language, 2017
- Long Short-Term Memory2012