Relevance is more significant than correlation: Information filtering on sparse data
Authors:
- Yi-Cheng ZhangYZYi-Cheng Zhang
- Tao ZhouTao Zhou
- 1 December 2009
- journal article
- research article
- Published by IOP Publishing in Europhysics Letters
- Vol. 88 (6)
Abstract
In some recommender systems where users can vote objects by ratings, the similarity between users can be quantified by a benchmark index, namely the Pearson correlation coefficient, which reflects the rating correlations. Another alternative way is to calculate the similarity based solely on the relevance information, namely whether a user has voted an object. The former one uses more information than the latter, and is intuitively expected to give more accurate rating predictions under the standard collaborative filtering framework. However, according to the extensive experimental analysis, this letter reports the opposite results that the latter method, making use of only the relevance information, can outperform the former method, especially when the data set is sparse. Our finding challenges the routine knowledge on information filtering, and suggests some alternatives to address the sparsity problem. Copyright c EPLA, 2009Keywords
This publication has 18 references indexed in Scilit:
- Information filtering via self-consistent refinementEurophysics Letters, 2008
- Effect of initial configuration on network-based recommendationEurophysics Letters, 2008
- Recommendation model based on opinion diffusionEurophysics Letters, 2007
- Bipartite network projection and personal recommendationPhysical Review E, 2007
- Heat Conduction Process on Community Networks as a Recommendation ModelPhysical Review Letters, 2007
- Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensionsIEEE Transactions on Knowledge and Data Engineering, 2005
- Extracting Hidden Information from Knowledge NetworksPhysical Review Letters, 2001
- Eigentaste: A Constant Time Collaborative Filtering AlgorithmInformation Retrieval Journal, 2001
- A Framework for Collaborative, Content-Based and Demographic FilteringArtificial Intelligence Review, 1999
- Recommender systemsCommunications of the ACM, 1997