Subspace Estimation with Automatic Dimension and Variable Selection in Sufficient Dimension Reduction
- 10 October 2022
- journal article
- research article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 119 (545) , 343-355
Abstract
Sufficient dimension reduction (SDR) methods target finding lower-dimensional representations of a multivariate predictor to preserve all the information about the conditional distribution of the response given the predictor. The reduction is commonly achieved by projecting the predictor onto a low-dimensional subspace. The smallest such subspace is known as the Central Subspace (CS) and is the key parameter of interest for most SDR methods. In this article, we propose a unified and flexible framework for estimating the CS in high dimensions. Our approach generalizes a wide range of model-based and model-free SDR methods to high-dimensional settings, where the CS is assumed to involve only a subset of the predictors. We formulate the problem as a quadratic convex optimization so that the global solution is feasible. The proposed estimation procedure simultaneously achieves the structural dimension selection and coordinate-independent variable selection of the CS. Theoretically, our method achieves dimension selection, variable selection, and subspace estimation consistency at a high convergence rate under mild conditions. We demonstrate the effectiveness and efficiency of our method with extensive simulation studies and real data examples. Supplementary materials for this article are available online.Keywords
Funding Information
- NSF - National Science Foundation
- U.S. National Science Foundation
This publication has 36 references indexed in Scilit:
- Coordinate-independent sparse sufficient dimension reduction and variable selectionThe Annals of Statistics, 2010
- Sparse Partial Least Squares Classification for High Dimensional DataStatistical Applications in Genetics and Molecular Biology, 2010
- Principal Fitted Components for Dimension Reduction in RegressionStatistical Science, 2008
- Determining the dimension of the central subspace and central mean subspaceBiometrika, 2008
- Measuring and testing dependence by correlation of distancesThe Annals of Statistics, 2007
- Sparse sufficient dimension reductionBiometrika, 2007
- Using the Bootstrap to Select One of a New Class of Dimension Reduction MethodsJournal of the American Statistical Association, 2003
- Determining the Dimensionality in Sliced Inverse RegressionJournal of the American Statistical Association, 1994
- On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein's LemmaJournal of the American Statistical Association, 1992
- Sliced Inverse Regression for Dimension ReductionJournal of the American Statistical Association, 1991