Noise is Inside Me! Generating Adversarial Perturbations with Noise Derived from Natural Filters
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3354-3363
Abstract
Deep learning solutions are vulnerable to adversarial perturbations and can lead a "frog" image to be misclassified as a "deer" or random pattern into "guitar". Adversarial attack generation algorithms generally utilize the knowledge of database and CNN model to craft the noise. In this research, we present a novel scheme termed as Camera Inspired Perturbations to generate adversarial noise. The proposed approach relies on the noise embedded in the image due to environmental factors or camera noise incorporated. We extract these noise patterns using image filtering algorithms and incorporate them into images to generate adversarial images. Unlike most of the existing algorithms that require learning of noise, the proposed adversarial noise can be applied in real-time. It is model-agnostic and can be utilized to fool multiple deep learning classifiers on various databases. The effectiveness of the proposed approach is evaluated on five different databases with five different convolutional neural networks such as ResNet-50, VGG-16, and VGG-Face. The proposed attack reduces the classification accuracy of every network, for instance, the performance of VGG-16 on the Tiny ImageNet database is reduced by more than 33%. The robustness of the proposed adversarial noise is also evaluated against different adversarial defense algorithms.Keywords
This publication has 28 references indexed in Scilit:
- Adversarial Diversity and Hard Positive Generation2016
- The Limitations of Deep Learning in Adversarial Settings2016
- Guided Image FilteringIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- No-Reference Image Quality Assessment in the Spatial DomainIEEE Transactions on Image Processing, 2012
- Local Laplacian filtersACM Transactions on Graphics, 2011
- Feature based RDWT watermarking for multimodal biometric systemImage and Vision Computing, 2009
- Digital Camera Identification From Sensor Pattern NoiseIEEE Transactions on Information Forensics and Security, 2006
- Digital watermarking based secure multimodal biometric system2005
- Steganalysis using image quality metricsIEEE Transactions on Image Processing, 2003
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992