PSAT-GAN: Efficient Adversarial Attacks Against Holistic Scene Understanding
- 27 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 30 (10577149) , 7541-7553
Abstract
Recent advances in deep neural networks (DNNs) have facilitated high-end applications, including holistic scene understanding (HSU), in which many tasks run in parallel with the same visual input. Following this trend, various methods have been proposed to use DNNs to perform multiple vision tasks. However, these methods are task-specific and less effective when considering multiple HSU tasks. End-to-end demonstrations of adversarial examples, which generate one-to-many heterogeneous adversarial examples in parallel from the same input, are scarce. Additionally, one-to-many mapping of adversarial examples for HSU usually requires joint representation learning and flexible constraints on magnitude, which can render the prevalent attack methods ineffective. In this paper, we propose PSAT-GAN, an end-to-end framework that follows the pipeline of HSU. It is based on a mixture of generative models and an adversarial classifier that employs partial weight sharing to learn a one-to-many mapping of adversarial examples in parallel, each of which is effective for its corresponding task in HSU attacks. PSAT-GAN is further enhanced by applying novel adversarial and soft-constraint losses to generate effective perturbations and avoid studying transferability. Experimental results indicate that our method is efficient in generating both universal and image-dependent adversarial examples to fool HSU tasks under either targeted or non-targeted settings.Keywords
Funding Information
- Field-Oriented Technology Development Project for Customs Administration through the National Research Foundation of Korea (NRF) through the Ministry of Science and ICT and Korea Customs Service (NRF-2021M3I1A1097938)
This publication has 26 references indexed in Scilit:
- Adversarial Examples for Semantic Segmentation and Object Detection2017
- Universal Adversarial Perturbations Against Semantic Image Segmentation2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- Universal Adversarial Perturbations2017
- Towards Evaluating the Robustness of Neural Networks2017
- DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks2016
- DeepDGA2016
- Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks2016
- The Limitations of Deep Learning in Adversarial Settings2016
- Fully convolutional networks for semantic segmentation2015