Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
Authors:
Open Access
- 1 August 2009
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 37 (4) , 1685-1704
Abstract
We consider the classical problem of estimating a vector μ=(μ1, …, μn) based on independent observations Yi∼N(μi, 1), i=1, …, n. Suppose μi, i=1, …, n are independent realizations from a completely unknown G. We suggest an easily computed estimator μ̂, such that the ratio of its risk E(μ̂−μ)2 with that of the Bayes procedure approaches 1. A related compound decision result is also obtained. Our asymptotics is of a triangular array; that is, we allow the distribution G to depend on n. Thus, our theoretical asymptotic results are also meaningful in situations where the vector μ is sparse and the proportion of zero coordinates approaches 1. We demonstrate the performance of our estimator in simulations, emphasizing sparse setups. In “moderately-sparse” situations, our procedure performs very well compared to known procedures tailored for sparse setups. It also adapts well to nonsparse situations.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- General maximum likelihood empirical Bayes estimation of normal meansThe Annals of Statistics, 2009
- In-season prediction of batting averages: A field test of empirical Bayes and Bayes methodologiesThe Annals of Applied Statistics, 2008
- General empirical Bayes wavelet methods and exactly adaptive minimax estimationThe Annals of Statistics, 2005
- Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequencesThe Annals of Statistics, 2004
- Robbins, empirical Bayes and microarraysThe Annals of Statistics, 2003
- Compound decision theory and empirical Bayes methods: invited paperThe Annals of Statistics, 2003
- Weak Convergence and Empirical Processes1996
- Ideal spatial adaptation by wavelet shrinkageBiometrika, 1994
- Admissible Estimators, Recurrent Diffusions, and Insoluble Boundary Value ProblemsThe Annals of Mathematical Statistics, 1971
- The Empirical Bayes Approach to Statistical Decision ProblemsThe Annals of Mathematical Statistics, 1964