Approximation by log-concave distributions, with applications to regression
Authors:
- Lutz DümbgenLDLutz Dümbgen
- Richard SamworthRSRichard Samworth
- Dominic SchuhmacherDSDominic Schuhmacher
Open Access
- 1 April 2011
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 39 (2) , 702-730
Abstract
We study the approximation of arbitrary distributions P on d-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback–Leibler-type functional. We show that such an approximation exists if and only if P has finite first moments and is not supported by some hyperplane. Furthermore we show that this approximation depends continuously on P with respect to Mallows distance D1(⋅, ⋅). This result implies consistency of the maximum likelihood estimator of a log-concave density under fairly general conditions. It also allows us to prove existence and consistency of estimators in regression models with a response Y=μ(X)+ε, where X and ε are independent, μ(⋅) belongs to a certain class of regression functions while ε is a random error with log-concave density and mean zero.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Maximum Likelihood Estimation of a Multi-Dimensional Log-Concave DensityJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Quasi-concave density estimationThe Annals of Statistics, 2010
- Inference and Modeling with Log-concave DistributionsStatistical Science, 2009
- Limit distribution theory for maximum likelihood estimation of a log-concave densityThe Annals of Statistics, 2009
- Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistencyBernoulli, 2009
- Convex Models, MLS and MisspecificationThe Annals of Statistics, 2001
- Breakdown Properties of Location Estimates Based on Halfspace Depth and Projected OutlyingnessThe Annals of Statistics, 1992
- Large Deviation Probabilities for Certain Nonparametric Maximum Likelihood EstimatorsThe Annals of Statistics, 1990
- A Note on Asymptotic Joint NormalityThe Annals of Mathematical Statistics, 1972
- The integral of a symmetric unimodal function over a symmetric convex set and some probability inequalitiesProceedings of the American Mathematical Society, 1955