SoK: Model Inversion Attack Landscape: Taxonomy, Challenges, and Future Roadmap
Author:
- 1 July 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 439-456
Abstract
A crucial module of the widely applied machine learning (ML) model is the model training phase, which involves large-scale training data, often including sensitive private data. ML models trained on these sensitive data suffer from significant privacy concerns since ML models can intentionally or unintendedly leak information about training data. Adversaries can exploit this information to perform privacy attacks, including model extraction, membership inference, and model inversion. While a model extraction attack steals and replicates a trained model functionality, and membership inference infers the data sample's inclusiveness to the training set, a model inversion attack has the goal of inferring the training data sample's sensitive attribute value or reconstructing the training sample (i.e., image/audio/text). Distinct and inconsistent characteristics of model inversion attack make this attack even more challenging and consequential, opening up model inversion attack as a more prominent and increasingly expanding research paradigm. Thereby, to flourish research in this relatively underexplored model inversion domain, we conduct the first-ever systematic literature review of the model inversion attack landscape. We characterize model inversion attacks and provide a comprehensive taxonomy based on different dimensions. We illustrate foundational perspectives emphasizing methodologies and key principles of the existing attacks and defense techniques. Finally, we discuss challenges and open issues in the existing model inversion attacks, focusing on the roadmap for future research directions.Keywords
This publication has 85 references indexed in Scilit:
- Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures2015
- NationTelescope: Monitoring and visualizing large-scale collective behavior in LBSNsJournal of Network and Computer Applications, 2015
- Machine learning applications in cancer prognosis and predictionComputational and Structural Biotechnology Journal, 2014
- Membership privacy2013
- Estimation of the Warfarin Dose with Clinical and Pharmacogenetic DataNew England Journal of Medicine, 2009
- Differential Privacy: A Survey of Results2008
- AUC: a misleading measure of the performance of predictive distribution modelsGlobal Ecology and Biogeography, 2007
- GLOBAL SYNCHRONIZATION OF COUPLED DELAYED NEURAL NETWORKS AND APPLICATIONS TO CHAOTIC CNN MODELSInternational Journal of Bifurcation and Chaos, 2004
- Estimating mutual informationPhysical Review E, 2004
- NewsWeeder: Learning to Filter Netnews1995