On the Integrity of Deep Learning Oracles
Preprint
Abstract
Deep Learning is increasingly used in several machine learning tasks as Deep Neural Networks (DNNs) frequently outperform other techniques. Yet, previous work showed that, once deployed, DNNs are vulnerable to integrity attacks. Indeed, adversaries can control DNN outputs and for instance force them to misclassify inputs by adding a carefully crafted and undistinguishable perturbation. However, these attacks assumed knowledge of the targeted DNN's architecture and parameters. In this paper however, we release these assumptions and introduce an attack conducted under the more realistic, yet more complex, threat model of an oracle: adversaries are only capable of accessing DNN label predictions for chosen inputs. We evaluate our attack in real-world settings by successfully forcing an oracle served by MetaMind, an online API for DNN classifiers, to misclassify inputs at a 84.24% rate. We also perform an evaluation to fine-tune our attack strategy and maximize the oracle's misclassification rate for adversarial samples.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks2016
- Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learningNature Biotechnology, 2015
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- Multi-column deep neural network for traffic sign classificationNeural Networks, 2012
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- A NEW METHOD FOR MAPPING OPTIMIZATION PROBLEMS ONTO NEURAL NETWORKSInternational Journal of Neural Systems, 1989
- Generalization of backpropagation with application to a recurrent gas market modelNeural Networks, 1988
- Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in positionPattern Recognition, 1982