Shining Light on the Inter-procedural Code Obfuscation: Keep Pace with Progress in Binary Diffing
Open Access
- 19 March 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 22 (1) , 1-28
Abstract
Software obfuscation techniques have lost their effectiveness due to the rapid development of binary diffing techniques, which can achieve accurate function matching and identification. In this paper, we propose a new inter-procedural code obfuscation mechanism KHaos , 1 which moves the code across functions to obfuscate the function by using compilation optimizations. Three obfuscation primitives are proposed to separate, aggregate, and hide the function. They can be combined to enhance the obfuscation effect further. This article also reveals distinguishing factors on obfuscation and compiler optimization and presents novel observations to gain insights into the impact of actively utilizing compiler optimization in obfuscation. A prototype of KHaos is implemented and evaluated on a large number of real-world programs. Experimental results show that KHaos outperforms existing code obfuscations and can significantly reduce the accuracy rates of six state-of-the-art binary diffing techniques with lower runtime overhead.Keywords
Funding Information
- CAS Project for Young Scientists in Basic Research (YSBR-118)
This publication has 62 references indexed in Scilit:
- Graph-Based Malware Detection Using Opcode Sequences2021
- Interpretation-Enabled Software Reuse Detection Based on a Multi-level Birthmark Model2021
- SAFE: Self-Attentive Function Embeddings for Binary Similarity2019
- BinMatch: A Semantics-Based Hybrid Approach on Binary Code Clone Analysis2018
- Manufacturing Resilient Bi-Opaque Predicates Against Symbolic Execution2018
- Enhance virtual-machine-based code obfuscation security through dynamic bytecode schedulingComputers & Security, 2018
- In-memory fuzzing for binary code similarity analysis2017
- Binary Code Clone Detection across Architectures and Compiling Configurations2017
- Evaluating Op-Code Frequency Histograms in Malware and Third-Party Mobile Applications2016
- Dex: a semantic-graph differencing tool for studying changes in large code bases2004