Towards Adversarial Robustness for Multi-Mode Data through Metric Learning
Open Access
Abstract
Adversarial attacks have become one of the most serious security issues in widely used deep neural networks. Even though real-world datasets usually have large intra-variations or multiple modes, most adversarial defense methods, such as adversarial training, which is currently one of the most effective defense methods, mainly focus on the single-mode setting and thus fail to capture the full data representation to defend against adversarial attacks. To confront this challenge, we propose a novel multi-prototype metric learning regularization for adversarial training which can effectively enhance the defense capability of adversarial training by preventing the latent representation of the adversarial example changing a lot from its clean one. With extensive experiments on CIFAR10, CIFAR100, MNIST, and Tiny ImageNet, the evaluation results show the proposed method improves the performance of different state-of-the-art adversarial training methods without additional computational cost. Furthermore, besides Tiny ImageNet, in the multi-prototype CIFAR10 and CIFAR100 where we reorganize the whole datasets of CIFAR10 and CIFAR100 into two and ten classes, respectively, the proposed method outperforms the state-of-the-art approach by 2.22% and 1.65%, respectively. Furthermore, the proposed multi-prototype method also outperforms its single-prototype version and other commonly used deep metric learning approaches as regularization for adversarial training and thus further demonstrates its effectiveness.Keywords
Funding Information
- National Science and Technology Council (NSTC) (110-2221-E-001-009-MY2, 111-2634-F-002-022, 111-2221-E-001-002, 111-2634-F-006-012, 111-2634-F-A49-010)
This publication has 31 references indexed in Scilit:
- SSD: Single Shot MultiBox Detector2016
- Deep Residual Learning for Image Recognition2016
- Deep Metric Learning via Lifted Structured Feature Embedding2016
- Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks2016
- The Limitations of Deep Learning in Adversarial Settings2016
- Deep Metric Learning Using Triplet Network2015
- Deep neural networks are easily fooled: High confidence predictions for unrecognizable images2015
- Going deeper with convolutions2015
- Deep learningNature, 2015
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998