Fast Moment-Based Estimation for Hierarchical Models
Preprint
Abstract
Hierarchical models allow for heterogeneous behaviours in a population while simultaneously borrowing estimation strength across all subpopulations. Unfortunately, existing likelihood-based methods for fitting hierarchical models have high computational demands, and these demands have limited their adoption in large-scale prediction and inference problems. This paper proposes a moment-based procedure for estimating the parameters of a hierarchical model which has its roots in a method originally introduced by Cochran in 1937. The method trades statistical efficiency for computational efficiency. It gives consistent parameter estimates, competitive prediction error performance, and substantial computational improvements. When applied to a large-scale recommender system application and compared to a standard maximum likelihood procedure, the method delivers competitive prediction performance while reducing the sequential computation time from hours to minutes.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Bayes and big data: the consensus Monte Carlo algorithmInternational Journal of Management Science and Engineering Management, 2016
- Sparse variational analysis of linear mixed models for large data setsStatistics & Probability Letters, 2011
- Bias reduction in exponential family nonlinear modelsBiometrika, 2009
- Matrix Factorization Techniques for Recommender SystemsComputer, 2009
- Challenges and opportunities in high-dimensional choice data analysesMarketing Letters, 2008
- Data Analysis Using Regression and Multilevel/Hierarchical Models2006
- Linear mixed models and penalized least squaresJournal of Multivariate Analysis, 2004
- A solution to the problem of separation in logistic regressionStatistics in Medicine, 2002
- A modified score function estimator for multinomial logistic regression in small samplesComputational Statistics & Data Analysis, 2002
- Large sample inference in random coefficient regression modelsCommunications in Statistics - Theory and Methods, 1986