Inference for Maximin Effects: A Sampling Approach to Aggregating Heterogenous High-dimensional Regression Models
Author:
Preprint
Abstract
Heterogeneity is an important feature of modern data analysis and a central task is to extract information from the massive and heterogeneous data. In this paper, we consider aggregation of heterogeneous regression vectors under multiple high-dimensional linear models. We adopt the definition of maximin effect (Meinshausen, B\"uhlmann, AoS, 43(4), 1801--1830) and further define the maximin effect for a targeted population by allowing for covariate shift. A ridge-type maximin effect is introduced to balance reward optimality and statistical stability. To identify the maximin effect in high dimensions, we estimate the regression covariance matrix by a debiased estimator and construct the optimal weight vector for the maximin effect. The resulted estimator of the maximin effect is not necessarily asymptotic normal since the constructed weight vector might have a mixture distribution. We devise a novel sampling approach to construct confidence intervals for any linear contrast of maximin effects in high dimensions. The coverage and precision properties of the constructed confidence intervals are studied. The proposed method is demonstrated over simulations and a genetic data set on growing yeast colonies under different environments.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Optimal Estimation of Genetic Relatedness in High-Dimensional Linear ModelsJournal of the American Statistical Association, 2018
- Linear Hypothesis Testing in Dense High-Dimensional Linear ModelsJournal of the American Statistical Association, 2018
- Generalized Fiducial Inference: A Review and New ResultsJournal of the American Statistical Association, 2016
- Robust inference on average treatment effects with possibly more covariates than observationsJournal of Econometrics, 2015
- Confidence Distribution, the Frequentist Distribution Estimator of a Parameter: A ReviewInternational Statistical Review, 2013
- Finding the sources of missing heritability in a yeast crossNature, 2013
- Scaled sparse linear regressionBiometrika, 2012
- Square-root lasso: pivotal recovery of sparse signals via conic programmingBiometrika, 2011
- Improving predictive inference under covariate shift by weighting the log-likelihood functionJournal of Statistical Planning and Inference, 2000
- Heterogeneity of ribosomal populations in Escherichia coli cells grown in different mediaMolecular Genetics and Genomics, 1972