Android Malware Detection: Building Useful Representations
Authors:
- Luiza SayfullinaLSLuiza Sayfullina
- Emil EirolaEEEmil Eirola
- Dmitry KomashinskyDKDmitry Komashinsky
- Paolo PalumboPPPaolo Palumbo
- Juha KarhunenJKJuha Karhunen
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 201-206
Abstract
The problem of proactively detecting Android Malware has proven to be a challenging one. The challenges stem from a variety of issues, but recent literature has shown that this task is hard to solve with high accuracy when only a restricted set of features, like permissions or similar fixed sets of features, are used. The opposite approach of including all available features is also problematic, as it causes the features space to grow beyond reasonable size. In this paper we focus on finding an efficient way to select a representative feature space, preserving its discriminative power on unseen data. We go beyond traditional approaches like Principal Component Analysis, which is too heavy for large-scale problems with millions of features. In particular we show that many feature groups that can be extracted from Android application packages, like features extracted from the manifest file or strings extracted from the Dalvik Executable (DEX), should be filtered and used in classification separately. Our proposed dimensionality reduction scheme is applied to each group separately and consists of raw string preprocessing, feature selection via log-odds and finally applying random projections. With the size of the feature space growing exponentially as a function of the training set's size, our approach drastically decreases the size of the feature space of several orders of magnitude, this in turn allows accurate classification to become possible in a real world scenario. After reducing the dimensionality we use the feature groups in a light-weight ensemble of logistic classifiers. We evaluated the proposed classification scheme on real malware data provided by the antivirus vendor and achieved state-of-the-art 88.24% true positive and reasonably low 0.04% false positive rates with a significantly compressed feature space on a balanced test set of 10,000 samples.Keywords
This publication has 9 references indexed in Scilit:
- Efficient Detection of Zero-day Android Malware Using Normalized Bernoulli Naive Bayes2015
- Identifying Unknown Android Malware with Feature Extractions and Classification Techniques2015
- High Precision Screening for Android Malware with Dimensionality Reduction2014
- Drebin: Effective and Explainable Detection of Android Malware in Your Pocket2014
- Large-scale malware classification using random projections and neural networks2013
- Very sparse random projections2006
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Database-friendly random projections: Johnson-Lindenstrauss with binary coinsJournal of Computer and System Sciences, 2003
- Support-vector networksMachine Learning, 1995