Large Multi‐Response Linear Regression Estimation Based on Low‐Rank Pre‐Smoothing
Open Access
- 20 April 2026
- journal article
- Published by Wiley in Statistical Analysis and Data Mining: An ASA Data Science Journal
- Vol. 19 (2)
Abstract
Pre‐smoothing is a technique aimed at increasing the signal‐to‐noise ratio in data to improve subsequent estimation and model selection in regression problems. However, pre‐smoothing has thus far been limited to the univariate response regression setting. However, there are many scientific applications in which interest lies in multi‐response regression problems, particularly when the number of responses is large. Motivated by this setting, this article proposes a technique for data pre‐smoothing based on low‐rank approximation. We establish theoretical results on the performance of the proposed methodology, which show that in this large‐response setting, the proposed technique outperforms ordinary least squares estimation with the mean squared error criterion, whilst being computationally more efficient than alternative approaches such as reduced rank regression. We quantify our estimator's benefit empirically in a number of simulated experiments. We also demonstrate our proposed low‐rank pre‐smoothing technique on real data arising from the environmental and biological sciences.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Multiple Change Points Detection in High-Dimensional Multivariate RegressionJournal of Systems Science and Complexity, 2022
- Multivariate Reduced-Rank Regression2022
- Abundant Pleiotropy in Human Complex Diseases and TraitsThe American Journal of Human Genetics, 2011
- Principal Component Analysis2011
- Computation of Multivariate Normal and t Probabilities2009
- Modern Multivariate Statistical Techniques2008
- Effects of gastropod grazers on recruitment and succession of an estuarine assemblage: a multivariate and univariate approachOecologia, 1997
- Multivariate data analysis applied to low-density polyethylene reactorsChemometrics and Intelligent Laboratory Systems, 1992
- The asymptotic variance matrix of the sample correlation matrixLinear Algebra and its Applications, 1990
- Reduced-rank regression for the multivariate linear modelJournal of Multivariate Analysis, 1975