SMS spam filtering and thread identification using bi-level text classification and clustering techniques
- 10 July 2016
- journal article
- research article
- Published by SAGE Publications in Journal of Information Science
- Vol. 43 (1) , 75-87
Abstract
SMS spam detection is an important task where spam SMS messages are identified and filtered. As greater numbers of SMS messages are communicated every day, it is very difficult for a user to remember and correlate the newer SMS messages received in context to previously received SMS. SMS threads provide a solution to this problem. In this work the problem of SMS spam detection and thread identification is discussed and a state of the art clustering-based algorithm is presented. The work is planned in two stages. In the first stage the binary classification technique is applied to categorize SMS messages into two categories namely, spam and non-spam SMS; then, in the second stage, SMS clusters are created for non-spam SMS messages using non-negative matrix factorization and K-means clustering techniques. A threading-based similarity feature, that is, time between consecutive communications, is described for the identification of SMS threads, and the impact of the time threshold in thread identification is also analysed experimentally. Performance parameters like accuracy, precision, recall and F-measure are also evaluated. The SMS threads identified in this proposed work can be used in applications like SMS thread summarization, SMS folder classification and other SMS management-related tasks.Keywords
This publication has 32 references indexed in Scilit:
- Neighborhoods and bands: an analysis of the origins of spamJournal of Internet Services and Applications, 2015
- A learning approach for email conversation thread reconstructionJournal of Information Science, 2013
- SMS spam filtering: Methods and dataExpert Systems with Applications, 2012
- Identifying clinical course patterns in SMS data using cluster analysisChiropractic & Manual Therapies, 2012
- A Study on Analysis of SMS Classification Using Document Frequency ThresoldInternational Journal of Information Engineering and Electronic Business, 2012
- Hybrid spam filtering for mobile communicationComputers & Security, 2010
- Index-based Online Text Classification for SMS Spam FilteringJournal of Computers, 2010
- Conversation Extraction in Dynamic Text Message StreamJournal of Computers, 2008
- Single-document and multi-document summarization techniques for email threads using sentence compressionInformation Processing & Management, 2008
- Email Spam Filtering: A Systematic ReviewFoundations and Trends® in Information Retrieval, 2008