Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistency
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 16363-16372
Abstract
Deep neural networks are proven to be vulnerable to backdoor attacks. Detecting the trigger samples during the inference stage, i.e., the test-time trigger sample detection, can prevent the backdoor from being triggered. However, existing detection methods often require the defenders to have high accessibility to victim models, extra clean data, or knowledge about the appearance of backdoor triggers, limiting their practicality. In this paper, we propose the test-time corruption robustness consistency evaluation (TeCo) 1 1 https://github.com/CGCL-codes/TeCo, a novel test-time trigger sample detection method that only needs the hard-label outputs of the victim models without any extra information. Our journey begins with the intriguing observation that the backdoor-infected models have similar performance across different image corruptions for the clean images, but perform discrepantly for the trigger samples. Based on this phenomenon, we design TeCo to evaluate test-time robustness consistency by calculating the deviation of severity that leads to predictions' transition across different corruptions. Extensive experiments demonstrate that compared with state-of-the-art defenses, which even require either certain information about the trigger types or accessibility of clean data, TeCo outperforms them on different backdoor attacks, datasets, and model architectures, enjoying a higher AUROC by 10% and 5 times of stability.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (U20A20177)
This publication has 23 references indexed in Scilit:
- STRIP2019
- Machine Learning in Resource-Scarce Embedded Systems, FPGAs, and End-Devices: A SurveyElectronics, 2019
- Neural Cleanse: Identifying and Mitigating Backdoor Attacks in Neural Networks2019
- BadNets: Evaluating Backdooring Attacks on Deep Neural NetworksIEEE Access, 2019
- Cloud-DNN2019
- A Configurable Cloud-Scale DNN Processor for Real-Time AI2018
- Privacy-preserving Machine Learning as a ServiceProceedings on Privacy Enhancing Technologies, 2018
- MLaaS: Machine Learning as a Service2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Detection of traffic signs in real-world images: The German traffic sign detection benchmark2013