Learning recommender systems with adaptive regularization
Author:
Open Access
- 8 February 2012
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 133-142
Abstract
Many factorization models like matrix or tensor factorization have been proposed for the important application of recommender systems. The success of such factorization models depends largely on the choice of good values for the regularization parameters. Without a careful selection they result in poor prediction quality as they either underfit or overfit the data. Regularization values are typically determined by an expensive search that requires learning the model parameters several times: once for each tuple of candidate values for the regularization parameters. In this paper, we present a new method that adapts the regularization automatically while training the model parameters. To achieve this, we optimize simultaneously for two criteria: (1) as usual the model parameters for the regularized objective and (2) the regularization of future parameter updates for the best predictive quality on a validation set. We develop this for the generic model class of Factorization Machines which subsumes a wide variety of factorization models. We show empirically, that the advantages of our adaptive regularization method compared to expensive hyperparameter search do not come to the price of worse predictive quality. In total with our method, learning regularization parameters is as easy as learning model parameters and thus there is no need for any time-consuming search of regularization values because they are found on-the-fly. This makes our method highly attractive for practical use.Keywords
This publication has 16 references indexed in Scilit:
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Temporal Collaborative Filtering with Bayesian Probabilistic Tensor Factorization2010
- Pairwise interaction tensor factorization for personalized tag recommendation2010
- SoRec2008
- Factorization meets the neighborhood2008
- Fast maximum margin matrix factorization for collaborative prediction2005
- Latent semantic models for collaborative filteringACM Transactions on Information Systems, 2004
- A Multilinear Singular Value DecompositionSIAM Journal on Matrix Analysis and Applications, 2000
- Adaptive Regularization in Neural Network Modeling1998
- Some Mathematical Notes on Three-Mode Factor AnalysisPsychometrika, 1966