A Comprehensive Defense Framework Against Model Extraction Attacks
- 24 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Dependable and Secure Computing
- Vol. 21 (2) , 685-700
Abstract
As a promising service, Machine Learning as a Service (MLaaS) provides personalized inference functions for clients through paid APIs. Nevertheless, it is vulnerable to model extraction attacks, in which an attacker can extract a functionally-equivalent model by repeatedly querying the APIs with crafted samples. While numerous works have been proposed to defend against model extraction attacks, existing efforts are accompanied by limitations and low comprehensiveness. In this paper, we propose AMAO, a comprehensive defense framework against model extraction attacks. Specifically, AMAO consists of four interlinked successive phases: adversarial training is first exploited to weaken the effectiveness of model extraction attacks. Then, malicious query detection is used to detect malicious queries and mark malicious users. After that, we develop a label-flipping poisoning attack to instruct the adaptive query responses to malicious users. Besides, the image pHash algorithm is employed to ensure the indistinguishability of the query responses. Finally, the perturbed results are served as a backdoor to verify the ownership of any suspicious model. Extensive experiments demonstrate that AMAO outperforms existing defenses in defending against model extraction attacks and is also robust against the adaptive adversary who is aware of the defense.Keywords
Funding Information
- National Natural Science Foundation of China (62020106013, 61972454, 61802051, 61772121, 61728102)
- Sichuan Science and Technology Program (2020JDTD0007, 2020YFG0298)
- Fundamental Research Funds for Chinese Central Universities (ZYGX2020ZB027)
- Singapore Ministry of Education AcRF Tier 2 (MOET2EP20121-0006)
This publication has 42 references indexed in Scilit:
- Data-Free Model Extraction2021
- Label flipping attacks against Naive Bayes on spam filtering systemsApplied Intelligence, 2021
- Perturbing Inputs to Prevent Model Stealing2020
- DaST: Data-Free Substitute Training for Adversarial Attacks2020
- Defending Against Model Stealing Attacks With Adaptive Misinformation2020
- On defending against label flipping attacks on malware detection systemsNeural Computing and Applications, 2020
- Knockoff Nets: Stealing Functionality of Black-Box Models2019
- PRADA: Protecting Against DNN Model Stealing Attacks2019
- Learning Transferable Architectures for Scalable Image Recognition2018
- DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks2016