Efficient Adversarial Training With Transferable Adversarial Examples
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1178-1187
Abstract
Adversarial training is an effective defense method to protect classification models against adversarial attacks. However, one limitation of this approach is that it can require orders of magnitude additional training time due to high cost of generating strong adversarial examples during training. In this paper, we first show that there is high transferability between models from neighboring epochs in the same training process, i.e., adversarial examples from one epoch continue to be adversarial in subsequent epochs. Leveraging this property, we propose a novel method, Adversarial Training with Transferable Adversarial Examples (ATTA), that can enhance the robustness of trained models and greatly improve the training efficiency by accumulating adversarial perturbations through epochs. Compared to state-of-the-art adversarial training methods, ATTA enhances adversarial accuracy by up to 7.2% on CIFAR10 and requires 12~14x less training time on MNIST and CIFAR10 datasets with comparable model robustness.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Learning Transferable Adversarial Examples via Ghost NetworksProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Adversarial Defense via Learning to Generate Diverse Attacks2019
- Bilateral Adversarial Training: Towards Fast Training of More Robust Models Against Adversarial Attacks2019
- Curriculum Adversarial Training2018
- Adversarial Examples Are Not Easily Detected2017
- Practical Black-Box Attacks against Machine Learning2017
- Accessorize to a Crime2016
- ImageNet: A large-scale hierarchical image database2009
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998