Robust and Generalized Physical Adversarial Attacks via Meta-GAN
- 21 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 19 (15566013) , 1112-1125
Abstract
Deep neural networks are known to be vulnerable to adversarial examples, where adding carefully crafted adversarial perturbations to the inputs can mislead the DNN model. However, it is challenging to generate effective adversarial examples in the physical world due to many uncontrollable physical dynamics, which pose security and safety threats in the real world. Current physical attack methods aim to generate robust physical adversarial examples by simulating all possible physical dynamics. If attacking a new image or a new DNN model, they require expensive manual efforts for simulating physical dynamics or considerable time for iteratively optimizing. To tackle these limitations, we propose a robust and generalized physical adversarial attack method with Meta-GAN (Meta-GAN Attack), which is able to not only generate robust physical adversarial examples, but also generalize to attacking novel images and novel DNN models by accessing a few digital and physical images. First, we propose to craft robust physical adversarial examples with a generative attack model via simulating color and shape distortions. Second, we formulate the physical attack as a few-shot learning problem and design a novel class-agnostic and model-agnostic meta-learning algorithm to solve this problem. Extensive experiments on two benchmark datasets with four challenging experimental settings verify the superior robustness and generalization of our method by comparing to state-of-the-art physical attack methods. The source code is released at github.Keywords
Funding Information
- National Nature Science Foundation of China (62021001, 62071122, 12150007, 62076213)
- National Defense Basic Scientific Research Program (JCKY2020903B002)
- Shenzhen Science and Technology Program (RCYX20210609103057050)
- CCF-Hikvision Open Fund
This publication has 28 references indexed in Scilit:
- Generating Adversarial Examples with Adversarial Networks2018
- Generative Adversarial Perturbations2018
- Threat of Adversarial Attacks on Deep Learning in Computer Vision: A SurveyIEEE Access, 2018
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- Universal Adversarial Perturbations2017
- Towards Evaluating the Robustness of Neural Networks2017
- DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks2016
- Accessorize to a Crime2016
- Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognitionNeural Networks, 2012
- ImageNet: A large-scale hierarchical image database2009