Mate! Are You Really Aware? An Explainability-Guided Testing Framework for Robustness of Malware Detectors
Open Access
- 30 November 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1573-1585
Abstract
Numerous open-source and commercial malware detectors are available. However, their efficacy is threatened by new adversarial attacks, whereby malware attempts to evade detection, e.g., by performing feature-space manipulation. In this work, we propose an explainability-guided and model-agnostic testing framework for robustness of malware detectors when confronted with adversarial attacks. The framework introduces the concept of Accrued Malicious Magnitude (AMM) to identify which malware features could be manipulated to maximize the likelihood of evading detection. We then use this framework to test several state-of-the-art malware detectors' ability to detect manipulated malware. We find that (i) commercial antivirus engines are vulnerable to AMM-guided test cases; (ii) the ability of a manipulated malware generated using one detector to evade detection by another detector (i.e., transferability) depends on the overlap of features with large AMM values between the different detectors; and (iii) AMM values effectively measure the fragility of features (i.e., capability of feature-space manipulation to flip the prediction results) and explain the robustness of malware detectors facing evasion attacks. Our findings shed light on the limitations of current malware detectors, as well as how they can be improved.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Functionality-Preserving Black-Box Optimization of Adversarial Windows MalwareIEEE Transactions on Information Forensics and Security, 2021
- How Can We Craft Large-Scale Android Malware? An Automated Poisoning Attack2019
- Adversarial Attacks on Mobile Malware Detection2019
- Robust Physical-World Attacks on Deep Learning Visual Classification2018
- DeepRefiner: Multi-layer Android Malware Detection System Applying Deep Neural Networks2018
- Adversarial Examples for Malware Detection2017
- Lightweight, Obfuscation-Resilient Detection and Family Identification of Android MalwareACM Transactions on Software Engineering and Methodology, 2017
- Towards Evaluating the Robustness of Neural Networks2017
- Stealth attacks: An extended insight into the obfuscation effects on Android malwareComputers & Security, 2015
- SoK: Deep Packer Inspection: A Longitudinal Study of the Complexity of Run-Time Packers2015