A Group-Specific Recommender System
Authors:
- 29 June 2017
- journal article
- theory and-methods
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 112 (519) , 1344-1353
Abstract
In recent years, there has been a growing demand to develop efficient recommender systems which track users’ preferences and recommend potential items of interest to users. In this article, we propose a group-specific method to use dependency information from users and items which share similar characteristics under the singular value decomposition framework. The new approach is effective for the “cold-start” problem, where, in the testing set, majority responses are obtained from new users or for new items, and their preference information is not available from the training set. One advantage of the proposed model is that we are able to incorporate information from the missing mechanism and group-specific features through clustering based on the numbers of ratings from each user and other variables associated with missing patterns. In addition, since this type of data involves large-scale customer records, traditional algorithms are not computationally scalable. To implement the proposed method, we propose a new algorithm that embeds a back-fitting algorithm into alternating least squares, which avoids large matrices operation and big memory storage, and therefore makes it feasible to achieve scalable computing. Our simulation studies and MovieLens data analysis both indicate that the proposed group-specific method improves prediction accuracy significantly compared to existing competitive recommender system approaches. Supplementary materials for this article are available online.Keywords
This publication has 29 references indexed in Scilit:
- Statistical Significance of the Netflix ChallengeStatistical Science, 2012
- Consistent selection of the number of clusters via crossvalidationBiometrika, 2010
- Factor in the neighborsACM Transactions on Knowledge Discovery From Data, 2010
- Least angle regressionThe Annals of Statistics, 2004
- Probability Inequalities for Likelihood Ratios and Convergence Rates of Sieve MLESThe Annals of Statistics, 1995
- Convergence of the backfitting algorithm for additive modelsJournal of the Australian Mathematical Society. Series A. Pure Mathematics and Statistics, 1994
- Convergence Rate of Sieve EstimatesThe Annals of Statistics, 1994
- Hellinger-Consistency of Certain Nonparametric Maximum Likelihood EstimatorsThe Annals of Statistics, 1993
- Estimating Optimal Transformations for Multiple Regression and CorrelationJournal of the American Statistical Association, 1985
- Inference and missing dataBiometrika, 1976