Dimension reduction for the conditional mean in regressions with categorical predictors
Authors:
- Bing LiBLBing Li
- R. Dennis CookRCR. Dennis Cook
- Francesca ChiaromonteFCFrancesca Chiaromonte
Open Access
- 1 October 2003
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 31 (5) , 1636-1668
Abstract
Consider the regression of a response Y on a vector of quantitative predictors $\X$ and a categorical predictor W. In this article we describe a first method for reducing the dimension of $\X$ without loss of information on the conditional mean $\mathrm{E}(Y|\X,W)$ and without requiring a prespecified parametric model. The method, which allows for, but does not require, parametric versions of the subpopulation mean functions $\mathrm{E}(Y|\X,W=w)$, includes a procedure for inference about the dimension of $\X$ after reduction. This work integrates previous studies on dimension reduction for the conditional mean $\mathrm{E}(Y|\X)$ in the absence of categorical predictors and dimension reduction for the full conditional distribution of $Y|(\X,W)$. The methodology we describe may be particularly useful for constructing low-dimensional summary plots to aid in model-building at the outset of an analysis. Our proposals provide an often parsimonious alternative to the standard technique of modeling with interaction terms to adapt a mean function for different subpopulations determined by the levels of W. Examples illustrating this and other aspects of the development are presented.
Keywords
This publication has 16 references indexed in Scilit:
- Dimension reduction for conditional mean in regressionThe Annals of Statistics, 2002
- Sufficient dimensions reduction in regressions with categorical predictorsThe Annals of Statistics, 2002
- Estimating the Structural Dimension of Regressions Via Parametric Inverse RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001
- Dimension Reduction in Binary Response RegressionJournal of the American Statistical Association, 1999
- Principal Hessian Directions RevisitedJournal of the American Statistical Association, 1998
- Graphics for Regressions with a Binary ResponseJournal of the American Statistical Association, 1996
- On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein's LemmaJournal of the American Statistical Association, 1992
- Sliced Inverse Regression for Dimension Reduction: CommentJournal of the American Statistical Association, 1991
- Sliced Inverse Regression for Dimension ReductionJournal of the American Statistical Association, 1991
- Regression Analysis Under Link ViolationThe Annals of Statistics, 1989