Oracle Inequalities for a Group Lasso Procedure Applied to Generalized Linear Models in High Dimension
Authors:
- 30 January 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 60 (4) , 2303-2318
Abstract
We present a group lasso procedure for generalized linear models (GLMs) and we study the properties of this estimator applied to sparse high-dimensional GLMs. Under general conditions on the covariates and on the joint distribution of the pair covariates, we provide oracle inequalities promoting group sparsity of the covariables. We get convergence rates for the prediction and estimation error and we show the ability of this estimator to recover good sparse approximation of the true model. Then, we extend this procedure to the case of an elastic net penalty. At last, we apply these results to the so-called Poisson regression model (the output is modeled as a Poisson process whose intensity relies on a linear combination of the covariables). The group lasso method enables to select few groups of meaningful variables among the set of inputs.Keywords
This publication has 28 references indexed in Scilit:
- A Unified Framework for High-Dimensional Analysis of $M$-Estimators with Decomposable RegularizersStatistical Science, 2012
- Oracle inequalities and optimal inference under group sparsityThe Annals of Statistics, 2011
- Consistent group selection in high-dimensional linear regressionBernoulli, 2010
- The Group Lasso for Logistic RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- On the asymptotic properties of the group lasso estimator for linear modelsElectronic Journal of Statistics, 2008
- Adaptive estimation with soft thresholding penaltiesStatistica Neerlandica, 2002
- Expression profiling using cDNA microarraysNature Genetics, 1999
- Exploring the new world of the genome with DNA microarraysNature Genetics, 1999
- Weak Convergence and Empirical Processes1996
- Probability Inequalities for the Sum of Independent Random VariablesJournal of the American Statistical Association, 1962