Bypassing Anti-Analysis of Commercial Protector Methods Using DBI Tools
Open Access
- 1 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 7655-7673
Abstract
As most malware is infectious, anti-analysis and packing techniques supported by commercial protectors are conventionally applied to hinder analysis. When analyzing to detect and block such protected malware, it is necessary to do so in a virtual environment to prevent infection. In terms of packing, it is necessary to analyze using dynamic binary instrumentation (DBI), a dynamic analysis tool, which is advantageous for unpacking because DBI inserts code at run time and analyzes it dynamically. However, malware terminates on its own when it detects a virtual environment or DBI due to anti-analysis techniques. Therefore, it is necessary to also bypass anti-VM and anti-DBI techniques in order to successfully analyze malware in a virtual environment using DBI. It is very difficult for analysts to bypass anti-VM and anti-DBI techniques that are used in commercial protectors because analysts generally have little information on what methods are used or how to even bypass these techniques. In this paper, we suggest guidelines to aid in easy analysis of malware protected by anti-VM and anti-DBI techniques supported by commercial protectors. We analyzed the techniques used by five of the most common commercial protectors, and herein present how to bypass anti-VM and anti-DBI techniques supported by commercial protectors via a detailed algorithm analysis. We performed a bypass experiment after applying each commercial protector to 1573 executable files containing vulnerabilities provided by the National Institute of Standards and Technology (NIST). To our knowledge, this is the first empirical study to suggest detailed bypassing algorithms for anti-VM and anti-DBI techniques used in commercial protectors.Keywords
Funding Information
- Korean Government Ministry of Science and ICT (NRF-2017R1A2B3009643)
This publication has 11 references indexed in Scilit:
- On the Dissection of Evasive MalwareIEEE Transactions on Information Forensics and Security, 2020
- Performance Comparison of the type-2 hypervisor VirtualBox and VMWare Workstation2019
- SoK2019
- Automatic Detection and Bypassing of Anti-Debugging Techniques for Microsoft Windows EnvironmentsAdvances in Electrical and Computer Engineering, 2019
- Towards Paving the Way for Large-Scale Windows Malware Analysis2018
- UnThemida: Commercial obfuscation technique analysis with a fully obfuscated programSoftware: Practice and Experience, 2018
- Handling Anti-Virtual Machine Techniques in Malicious SoftwareACM Transactions on Privacy and Security, 2017
- Measuring and Defeating Anti-Instrumentation-Equipped Malware2017
- Advanced or Not? A Comparative Study of the Use of Anti-debugging and Anti-VM Techniques in Generic and Targeted Malware2016
- Towards an understanding of anti-virtualization and anti-debugging behavior in modern malware2008