Deep Partial Least Squares for Instrumental Variable Regression
Authors:
Preprint
Abstract
In this paper, we propose deep partial least squares for the estimation of high-dimensional nonlinear instrumental variable regression. As a precursor to a flexible deep neural network architecture, our methodology uses partial least squares for dimension reduction and feature selection from the set of instruments and covariates. A central theoretical result, due to Brillinger (2012) shows that the feature selection provided by partial least squares is consistent and the weights are estimated up to a proportionality constant. We illustrate our methodology with synthetic datasets with a sparse and correlated network structure and draw applications to the effect of childbearing on the mother's labor supply based on classic data of Angrist and Evans (1996). The results on synthetic data as well as applications show that the deep partial least squares method significantly outperforms other related methods. Finally, we conclude with directions for future research.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- Progress in partial least squares structural equation modeling use in marketing research in the last decadePsychology & Marketing, 2022
- On decision regions of narrow deep neural networksNeural Networks, 2021
- Bayesian l0‐regularized least squaresApplied Stochastic Models in Business and Industry, 2018
- Error bounds for approximations with deep ReLU networksNeural Networks, 2017
- An optimized RBF neural network algorithm based on partial least squares and genetic algorithm for classification of small sampleApplied Soft Computing, 2016
- Stein's Lemma for elliptical random vectorsJournal of Multivariate Analysis, 2008
- Two-stage residual inclusion estimation: Addressing endogeneity in health econometric modelingJournal of Health Economics, 2008
- Natural conjugate priors for the instrumental variables regression model applied to the Angrist–Krueger dataJournal of Econometrics, 2007
- Partial least-squares regression: a tutorialAnalytica Chimica Acta, 1986
- Instrumental variable estimator for the nonlinear errors-in-variables modelJournal of Econometrics, 1985