On the Validity of a New SMS Spam Collection
Authors:
- Jose Maria Gomez HidalgoJHJose Maria Gomez Hidalgo
- Tiago A. AlmeidaTATiago A. Almeida
- Akebo YamakamiAYAkebo Yamakami
- 1 December 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 240-245
Abstract
Mobile phones are becoming the latest target of electronic junk mail. Recent reports clearly indicate that the volume of SMS spam messages are dramatically increasing year by year. Probably, one of the major concerns in academic settings was the scarcity of public SMS spam datasets, that are sorely needed for validation and comparison of different classifiers. To address this issue, we have recently proposed a new SMS Spam Collection that, to the best of our knowledge, is the largest, public and real SMS dataset available for academic studies. However, as it has been created by augmenting a previously existing database built using roughly the same sources, it is sensible to certify that there are no duplicates coming from them. So, in this paper we offer a comprehensive analysis of the new SMS Spam Collection in order to ensure that this does not happen, since it may ease the task of learning SMS spam classifiers and, hence, it could compromise the evaluation of methods. The analysis of results indicate that the procedure followed does not lead to near-duplicates and, consequently, the proposed dataset is reliable to use for evaluating and comparing the performance achieved by different classifiers.Keywords
This publication has 7 references indexed in Scilit:
- Facing the spammers: A very effective approach to avoid junk e-mailsExpert Systems with Applications, 2011
- Contributions to the study of SMS spam filtering2011
- Spam filtering: how the dimensionality reduction affects the accuracy of Naive Bayes classifiersJournal of Internet Services and Applications, 2010
- Evaluation of Approaches for Dimensionality Reduction Applied with Naive Bayes Anti-Spam Filters2009
- Email Spam Filtering: A Systematic ReviewFoundations and Trends® in Information Retrieval, 2008
- Feature engineering for mobile (SMS) spam filtering2007
- Content based SMS spam filtering2006