McBoost: Boosting Scalability in Malware Collection and Analysis Using Statistical Classification of Executables
Authors:
- Roberto PerdisciRPRoberto Perdisci
- Andrea LanziALAndrea Lanzi
- Wenke LeeWLWenke Lee
- 1 December 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10639527,p. 301-310
Abstract
In this work, we propose Malware Collection Booster (McBoost), a fast statistical malware detection tool that is intended to improve the scalability of existing malware collection and analysis approaches. Given a large collection of binaries that may contain both hitherto unknown malware and benign executables, McBoost reduces the overall time of analysis by classifying and filtering out the least suspicious binaries and passing only the most suspicious ones to a detailed binary analysis process for signature extraction.The McBoost framework consists of a classifier specialized in detecting whether an executable is packed or not, a universal unpacker based on dynamic binary analysis, and a classifier specialized in distinguishing between malicious or benign code. We developed a proof-of-concept version of McBoost and evaluated it on 5,586 malware and 2,258 benign programs. McBoost has an accuracy of 87.3%, and an Area Under the ROC curve (AUC) equal to 0.977. Our evaluation also shows that McBoost reduces the overall time of analysis to only a fraction (e.g., 13.4%) of the computation time that would otherwise be required to analyze large sets of mixed malicious and benign executables.Keywords
This publication has 14 references indexed in Scilit:
- Classification of packed executables for accurate computer virus detectionPattern Recognition Letters, 2008
- Panorama2007
- Malicious Codes Detection Based on Ensemble LearningLecture Notes in Computer Science, 2007
- Opcodes as predictor for malwareInternational Journal of Electronic Security and Digital Forensics, 2007
- Using an Ensemble of One-Class SVM Classifiers to Harden Payload-based Anomaly Detection SystemsIEEE International Conference on Data Mining (ICDM), 2006
- N-gram analysis for computer virus detectionJournal of Computer Virology and Hacking Techniques, 2006
- Malware prevalence in the KaZaA file-sharing network2006
- Predicting good probabilities with supervised learning2005
- Data mining methods for detection of new malicious executables2002
- Bagging predictorsMachine Learning, 1996