Adversarial Reinforcement Learning under Partial Observability in Software-Defined Networking
Preprint
Abstract
Recent studies have demonstrated that reinforcement learning (RL) agents are susceptible to adversarial manipulation, similar to vulnerabilities previously demonstrated in the supervised setting. Accordingly focus has remained with computer vision, and full observability. This paper focuses on reinforcement learning in the context of autonomous defence in Software-Defined Networking (SDN). We demonstrate that causative attacks---attacks that target the training process---can poison RL agents even if the attacker only has partial observability of the environment. In addition, we propose an inversion defence method that aims to apply the opposite perturbation to that which an attacker might use to generate their adversarial samples. Our experimental results illustrate that the countermeasure can effectively reduce the impact of the causative attack, while not significantly affecting the training process in non-attack scenarios.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Adversarial Examples Detection in Deep Networks with Convolutional Filter Statistics2017
- Adversarially Robust Policy Learning: Active construction of physically-plausible perturbations2017
- Vulnerability of Deep Reinforcement Learning to Policy Induction Attacks2017
- Universal Adversarial Perturbations2017
- Towards Evaluating the Robustness of Neural Networks2017
- DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks2016
- Improving the Robustness of Deep Neural Networks via Stability Training2016
- Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks2016
- Deep neural networks are easily fooled: High confidence predictions for unrecognizable images2015
- The security of machine learningMachine Learning, 2010