Automatic Item Weight Generation for Pattern Mining and its Application
Authors:
- 1 July 2011
- journal article
- research article
- Published by IGI Global Scientific Publishing in International Journal of Data Warehousing and Mining
- Vol. 7 (3) , 30-49
Abstract
Association rule mining discovers relationships among items in a transactional database. Most approaches assume that all items within a dataset have a uniform distribution with respect to support. However, this is not always the case, and weighted association rule mining (WARM) was introduced to provide importance to individual items. Previous approaches to the weighted association rule mining problem require users to assign weights to items. In certain cases, it is difficult to provide weights to all items within a dataset. In this paper, the authors propose a method that is based on a novel Valency model that automatically infers item weights based on interactions between items. The authors experiment shows that the weighting scheme results in rules that better capture the natural variation that occurs in a dataset when compared with a miner that does not employ a weighting scheme. The authors applied the model in a real world application to mine text from a given collection of documents. The use of item weighting enabled the authors to attach more importance to terms that are distinctive. The results demonstrate that keyword discrimination via item weighting leads to informative rules.Keywords
This publication has 31 references indexed in Scilit:
- Mining Frequent Generalized Patterns for Web Personalization in the Presence of TaxonomiesInternational Journal of Data Warehousing and Mining, 2010
- Exception rules in association rule miningApplied Mathematics and Computation, 2008
- Redundant association rules reduction techniquesInternational Journal of Business Intelligence and Data Mining, 2007
- Finding Non-Coincidental Sporadic Rules Using Apriori-InverseInternational Journal of Data Warehousing and Mining, 2006
- Mining Association Rules in Data WarehousesInternational Journal of Data Warehousing and Mining, 2005
- ODAM: an optimized distributed association rule mining algorithmIEEE Distributed Systems Online, 2004
- Pebl:web page classification without negative examplesIEEE Transactions on Knowledge and Data Engineering, 2004
- Finding interesting associations without support pruningIEEE Transactions on Knowledge and Data Engineering, 2001
- CLARIT-TREC experimentsInformation Processing & Management, 1995
- Mining association rules between sets of items in large databasesACM SIGMOD Record, 1993