Data Poisoning and Backdoor Attacks on Audio Intelligence Systems
Authors:
- 27 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 61 (12) , 176-182
Abstract
Training high-performance audio models requires a large corpus of training samples, expensive computational resources, and expert knowledge. These costs are computationally intensive for individuals with limited resources. Consequently, users may turn to third-party resources, e.g., outsourcing the training to powerful cloud servers or automatically scraping data from the Internet. While these available resources provide a playground for developing audio models, a concerning fact is that malicious third parties may render users vulnerable to data poisoning and backdoor attacks. These attacks can seriously undermine the security and usability of the system supported by the audio model, sometimes with catastrophic consequences. In this paper, we review the existing schemes of the backdoor and data poisoning attacks on audio intelligence systems. We classify the state-of-the-art attack schemes into three categories based on their goals, i.e., untargeted poisoning attacks, triggerless attacks, and backdoor attacks. We briefly introduce the state-of-the-art solutions, followed by a comprehensive comparison. Moreover, we quantitatively compare several attack methods in terms of the performance of the attacks and the inaudibility of the poisoned examples. Finally, we highlight some promising future research directions in this field.Keywords
Funding Information
- National Key R&D Program of China (2020AAA0107701)
- NSFC (U20B2049,U21B2018,62161160337,61822309,61773310,U1736205,61802166,62132011)
This publication has 8 references indexed in Scilit:
- DriNet: Dynamic Backdoor Attack against Automatic Speech Recognization ModelsApplied Sciences, 2022
- Backdoor Attack Against Speaker Verification2021
- Detecting AI Trojans Using Meta Neural Analysis2021
- BadNets: Evaluating Backdooring Attacks on Deep Neural NetworksIEEE Access, 2019
- Trojaning Attack on Neural Networks2018
- Paragraph: Thwarting Signature Learning by Training Maliciously2006
- Speaker recognition: a tutorialProceedings of the IEEE, 1997
- Speech recognition by machine: A reviewProceedings of the IEEE, 1976