I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defences
Top Cited Papers
Open Access
- 17 July 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 55 (14s) , 1-41
Abstract
Machine-Learning-as-a-Service (MLaaS) has become a widespread paradigm, making even the most complex Machine Learning models available for clients via, e.g., a pay-per-query principle. This allows users to avoid time-consuming processes of data collection, hyperparameter tuning, and model training. However, by giving their customers access to the (predictions of their) models, MLaaS providers endanger their intellectual property such as sensitive training data, optimised hyperparameters, or learned model parameters. In some cases, adversaries can create a copy of the model with (almost) identical behaviour using the the prediction labels only. While many variants of this attack have been described, only scattered defence strategies that address isolated threats have been proposed. To arrive at a comprehensive understanding why these attacks are successful and how they could be holistically defended against, a thorough systematisation of the field of model stealing is necessary. We address this by categorising and comparing model stealing attacks, assessing their performance, and exploring corresponding defence techniques in different settings. We propose a taxonomy for attack and defence approaches and provide guidelines on how to select the right attack or defence strategy based on the goal and available resources. Finally, we analyse which defences are rendered less effective by current attack strategies.Keywords
All Related Versions
Funding Information
- European Union’s Horizon 2020 (826078)
This publication has 44 references indexed in Scilit:
- Model Compression and Acceleration for Deep Neural Networks: The Principles, Progress, and ChallengesIEEE Signal Processing Magazine, 2018
- Membership Inference Attacks Against Machine Learning Models2017
- ‘Security Theater’: On the Vulnerability of Classifiers to Exploratory AttacksLecture Notes in Computer Science, 2017
- Imitation LearningACM Computing Surveys, 2017
- How to steal a machine learning classifier with deep learning2017
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008
- Differential Privacy2006
- Remote Physical Device FingerprintingIEEE Transactions on Dependable and Secure Computing, 2005
- Timing Attacks on Implementations of Diffie-Hellman, RSA, DSS, and Other Systems1996