DARTS: Deceiving Autonomous Cars with Toxic Signs
Authors:
- Chawin SitawarinCSChawin Sitawarin
- Arjun Nitin BhagojiABArjun Nitin Bhagoji
- Arsalan MoseniaAMArsalan Mosenia
- Mung ChiangMCMung Chiang
- Prateek MittalPMPrateek Mittal
Preprint
Abstract
Sign recognition is an integral part of autonomous cars. Any misclassification of traffic signs can potentially lead to a multitude of disastrous consequences, ranging from a life-threatening accident to even a large-scale interruption of transportation services relying on autonomous cars. In this paper, we propose and examine security attacks against sign recognition systems for Deceiving Autonomous caRs with Toxic Signs (we call the proposed attacks DARTS). In particular, we introduce two novel methods to create these toxic signs. First, we propose Out-of-Distribution attacks, which expand the scope of adversarial examples by enabling the adversary to generate these starting from an arbitrary point in the image space compared to prior attacks which are restricted to existing training/test data (In-Distribution). Second, we present the Lenticular Printing attack, which relies on an optical phenomenon to deceive the traffic sign recognition system. We extensively evaluate the effectiveness of the proposed attacks in both virtual and real-world settings and consider both white-box and black-box threat models. Our results demonstrate that the proposed attacks are successful under both settings and threat models. We further show that Out-of-Distribution attacks can outperform In-Distribution attacks on classifiers defended using the adversarial training defense, exposing a new attack vector for these defenses.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Analysis of classifiers’ robustness to adversarial perturbationsMachine Learning, 2017
- Towards Evaluating the Robustness of Neural Networks2017
- DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks2016
- CABA: Continuous Authentication Based on BioAuraIEEE Transactions on Computers, 2016
- A Comprehensive Study of Security of Internet-of-ThingsIEEE Transactions on Emerging Topics in Computing, 2016
- Energy-Efficient Long-term Continuous Personal Health MonitoringIEEE Transactions on Multi-Scale Computing Systems, 2015
- Systematic Poisoning Attacks on and Defenses for Machine Learning in HealthcareIEEE Journal of Biomedical and Health Informatics, 2014
- Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and SurveyIEEE Transactions on Intelligent Transportation Systems, 2012
- Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognitionNeural Networks, 2012
- Fast Road Sign Detection Using Hough Transform for Assisted Driving of Road Vehicles2005