A Distributed Black-Box Adversarial Attack Based on Multi-Group Particle Swarm Optimization
Open Access
Abstract
Adversarial attack techniques in deep learning have been studied extensively due to its stealthiness to human eyes and potentially dangerous consequences when applied to real-life applications. However, current attack methods in black-box settings mainly employ a large number of queries for crafting their adversarial examples, hence making them very likely to be detected and responded by the target system (e.g., artificial intelligence (AI) service provider) due to its high traffic volume. A recent proposal able to address the large query problem utilizes a gradient-free approach based on Particle Swarm Optimization (PSO) algorithm. Unfortunately, this original approach tends to have a low attack success rate, possibly due to the model’s difficulty of escaping local optima. This obstacle can be overcome by employing a multi-group approach for PSO algorithm, by which the PSO particles can be redistributed, preventing them from being trapped in local optima. In this paper, we present a black-box adversarial attack which can significantly increase the success rate of PSO-based attack while maintaining a low number of query by launching the attack in a distributed manner. Attacks are executed from multiple nodes, disseminating queries among the nodes, hence reducing the possibility of being recognized by the target system while also increasing scalability. Furthermore, we utilize Multi-Group PSO with Random Redistribution (MGRR-PSO) for perturbation generation, performing better than the original approach against local optima, thus achieving a higher success rate. Additionally, we propose to efficiently remove excessive perturbation (i.e, perturbation pruning) by utilizing again the MGRR-PSO rather than a standard iterative method as used in the original approach. We perform five different experiments: comparing our attack’s performance with existing algorithms, testing in high-dimensional space in ImageNet dataset, examining our hyperparameters (i.e., particle size, number of clients, search boundary), and testing on real digital attack to Google Cloud Vision. Our attack proves to obtain a 100% success rate on MNIST and CIFAR-10 datasets and able to successfully fool Google Cloud Vision as a proof of the real digital attack by maintaining a lower query and wide applicability.Keywords
Funding Information
- Ministry of Science and ICT, South Korea (2019-0-01343, IITP-2020-0-01797)
This publication has 13 references indexed in Scilit:
- They Might NOT Be Giants Crafting Black-Box Adversarial Examples Using Particle Swarm Optimization2020
- GenAttack2019
- Tackling Permutation-based Optimization Problems with an Algebraic Particle Swarm Optimization AlgorithmFundamenta Informaticae, 2019
- Adversarial Examples: Attacks and Defenses for Deep LearningIEEE Transactions on Neural Networks and Learning Systems, 2019
- Threat of Adversarial Attacks on Deep Learning in Computer Vision: A SurveyIEEE Access, 2018
- Multimedia Big Data AnalyticsACM Computing Surveys, 2018
- ZOO2017
- Simple Black-Box Adversarial Attacks on Deep Neural Networks2017
- Practical Black-Box Attacks against Machine Learning2017
- DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks2016