On the Discredibility of Membership Inference Attacks
Preprint
Abstract
With the wide-spread application of machine learning models, it has become critical to study the potential data leakage of models trained on sensitive data. Recently, various membership inference (MI) attacks are proposed to determine if a sample was part of the training set or not. The question is whether these attacks can be reliably used in practice. We show that MI models frequently misclassify neighboring nonmember samples of a member sample as members. In other words, they have a high false positive rate on the subpopulations of the exact member samples that they can identify. We then showcase a practical application of MI attacks where this issue has a real-world repercussion. Here, MI attacks are used by an external auditor (investigator) to show to a judge/jury that an auditee unlawfully used sensitive data. Due to the high false positive rate of MI attacks on member's subpopulations, auditee challenges the credibility of the auditor by revealing the performance of the MI attacks on these subpopulations. We argue that current membership inference attacks can identify memorized subpopulations, but they cannot reliably identify which exact sample in the subpopulation was used during the training.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Accuracy-Privacy Trade-off in Deep Ensemble: A Membership Inference Perspective2023
- Enhanced Membership Inference Attacks against Machine Learning Models2022
- Results of the 3D Virtual Comparison Microscopy Error Rate (VCMER) Study for firearm forensicsJournal of Forensic Sciences, 2020
- SocInf: Membership Inference Attacks on Social Media Health Data With Machine LearningIEEE Transactions on Computational Social Systems, 2019
- Demystifying Membership Inference Attacks in Machine Learning as a ServiceIEEE Transactions on Services Computing, 2019
- ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Models2019
- Development and Validation of a Virtual Examination Tool for Firearm Forensics, ,Journal of Forensic Sciences, 2017
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998