Mining Approximate Frequent Itemsets from Noisy Data
Authors:
- Jinze LiuJLJinze Liu
- J. PrinsJPJ. Prins
- 5 January 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4 pp.
Abstract
Frequent itemset mining is a popular and important first step in analyzing data sets across a broad range of applications. The traditional, "exact" approach for finding frequent itemsets requires that every item in the itemset occurs in each supporting transaction. However, real data is typically subject to noise, and in the presence of such noise, traditional itemset mining may fail to detect relevant itemsets, particularly those large itemsets that are more vulnerable to noise. In this paper we propose approximate frequent itemsets (AFI), as a noise-tolerant itemset model. In addition to the usual requirement for sufficiently many supporting transactions, the AFI model places constraints on the fraction of errors permitted in each item column and the fraction of errors permitted in a supporting transaction. Taken together, these constraints winnow out the approximate itemsets that exhibit systematic errors. In the context of a simple noise model, we demonstrate that AFI is better at recovering underlying data patterns, while identifying fewer spurious patterns than either the exact frequent itemset approach or the existing error tolerant itemset approach of Yang et al.Keywords
This publication has 5 references indexed in Scilit:
- Support envelopes2004
- Mining gene expression databases for association rulesBioinformatics, 2003
- Biogeography of Australian freshwater fishesJournal of Biogeography, 2001
- Efficient discovery of error-tolerant frequent itemsets in high dimensions2001
- Mining association rules between sets of items in large databases1993