Big data and partial least‐squares prediction
- 7 April 2017
- journal article
- research article
- Published by Wiley in Canadian Journal of Statistics
- Vol. 46 (1) , 62-78
Abstract
We give a commentary on the challenges of big data for Statistics. We then narrow our discussion to one of those challenges: dimension reduction. This leads to consideration of one particular dimension reduction method—partial least‐squares (PLS) regression—for prediction in big high‐dimensional regressions where the sample size and the number of predictors are both large. We show that in some regression contexts single‐component PLS predictions converge at the usual root‐nrate asregardless of the relationship between the sample sizenand number of predictorsp. Asymptotically, PLS predictions then behave as regression predictions in the usual context wherepis fixed andThese results support the conjecture that PLS regression can be an effective method for prediction in big high‐dimensional regressions.The Canadian Journal of Statistics46: 62–78; 2018 © 2017 Statistical Society of CanadaKeywords
This publication has 48 references indexed in Scilit:
- Distribution based truncation for variable selection in subspace methods for multivariate regressionChemometrics and Intelligent Laboratory Systems, 2013
- Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable SelectionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Likelihood-Based Sufficient Dimension ReductionJournal of the American Statistical Association, 2009
- Principal Fitted Components for Dimension Reduction in RegressionStatistical Science, 2008
- Fisher Lecture: Dimension Reduction in RegressionStatistical Science, 2007
- Sufficient Dimension Reduction via Inverse RegressionJournal of the American Statistical Association, 2005
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- On the Interpretation of Regression PlotsJournal of the American Statistical Association, 1994
- A Statistical View of Some Chemometrics Regression ToolsTechnometrics, 1993
- Sliced Inverse Regression for Dimension ReductionJournal of the American Statistical Association, 1991