A Unified Theory of Confidence Regions and Testing for High-Dimensional Estimating Equations
Authors:
- Matey NeykovMNMatey Neykov
- Yang NingYNYang Ning
- Jun S. LiuJLJun S. Liu
- Han LiuHLHan Liu
- 1 August 2018
- journal article
- research article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 33 (3) , 427-443
Abstract
We propose a new inferential framework for constructing confidence regions and testing hypotheses in statistical models specified by a system of high-dimensional estimating equations. We construct an influence function by projecting the fitted estimating equations to a sparse direction obtained by solving a large-scale linear program. Our main theoretical contribution is to establish a unified Z-estimation theory of confidence regions for high-dimensional problems. Different from existing methods, all of which require the specification of the likelihood or pseudo-likelihood, our framework is likelihood-free. As a result, our approach provides valid inference for a broad class of high-dimensional constrained estimating equation problems, which are not covered by existing methods. Such examples include, noisy compressed sensing, instrumental variable regression, undirected graphical models, discriminant analysis and vector autoregressive models. We present detailed theoretical results for all these examples. Finally, we conduct thorough numerical simulations, and a real dataset analysis to back up the developed theoretical results.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Introduction to the non-asymptotic analysis of random matrices2012
- A Direct Estimation Approach to Sparse Linear Discriminant AnalysisJournal of the American Statistical Association, 2011
- A Constrainedℓ1Minimization Approach to Sparse Precision Matrix EstimationJournal of the American Statistical Association, 2011
- Stability SelectionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- p-Values for High-Dimensional RegressionJournal of the American Statistical Association, 2009
- The Dantzig selector: Statistical estimation when p is much larger than nThe Annals of Statistics, 2007
- Vascular endothelial growth factor receptor-2: Structure, function, intracellular signalling and therapeutic inhibitionCellular Signalling, 2007
- AGEMAP: a gene expression database for aging in micePLOS Genetics, 2005
- Multiple roots of estimating functionsCanadian Journal of Statistics, 1999
- Chapter 36 Large sample estimation and hypothesis testing1994