Membership Inference Attacks Fueled by Few-Shot Learning to Detect Privacy Leakage and Address Data Integrity
Open Access
- 20 May 2025
- journal article
- research article
- Published by MDPI AG in Machine Learning and Knowledge Extraction
- Vol. 7 (2) , 43
Abstract
Deep learning models have an intrinsic privacy issue as they memorize parts of their training data, creating a privacy leakage. Membership inference attacks (MIAs) exploit this to obtain confidential information about the data used for training, aiming to steal information. They can be repurposed as a measurement of data integrity by inferring whether the data were used to train a machine learning model. While state-of-the-art attacks achieve significant privacy leakage, their requirements render them infeasible, hindering their use as practical tools to assess the magnitude of the privacy risk. Moreover, the most appropriate evaluation metric of MIA, the true positive rate at a low false positive rate, lacks interpretability. We claim that the incorporation of few-shot learning techniques into the MIA field and a suitable qualitative and quantitative privacy evaluation measure should resolve these issues. In this context, our proposal is twofold. We propose a few-shot learning-based MIA, termed the FeS-MIA model, which eases the evaluation of the privacy breach of a deep learning model by significantly reducing the number of resources required for this purpose. Furthermore, we propose an interpretable quantitative and qualitative measure of privacy, referred to as the Log-MIA measure. Jointly, these proposals provide new tools to assess privacy leakages and to ease the evaluation of the training data integrity of deep learning models, i.e., to analyze the privacy breach of a deep learning model. Experiments carried out with MIA over image classification and language modeling tasks, and a comparison to the state of the art, show that our proposals excel in identifying privacy leakages in a deep learning model with little extra information.Keywords
All Related Versions
Funding Information
- National Institute of Cybersecurity (INCIBE) (IAFER-Cib (C074/23))
This publication has 28 references indexed in Scilit:
- Understanding and defending against White-box membership inference attack in deep learningKnowledge-Based Systems, 2022
- Survey on federated learning threats: Concepts, taxonomy on attacks and defences, experimental study and challengesInformation Fusion, 2022
- A survey on adversarial attacks in computer vision: Taxonomy, visualization and future directionsComputers & Security, 2022
- Membership Inference Attacks on Machine Learning: A SurveyACM Computing Surveys, 2022
- Securely Outsourcing Neural Network Inference to the Cloud With Lightweight TechniquesIEEE Transactions on Dependable and Secure Computing, 2022
- Revisiting Membership Inference Under Realistic AssumptionsProceedings on Privacy Enhancing Technologies, 2021
- Generalizing from a Few ExamplesACM Computing Surveys, 2020
- Mind your privacy: Privacy leakage through BCI applications using machine learning methodsKnowledge-Based Systems, 2020
- Understanding database reconstruction attacks on public dataCommunications of the ACM, 2019
- An introduction to ROC analysisPattern Recognition Letters, 2006