Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient algorithm
Authors:
- Hervé CardotHCHervé Cardot
- Peggy CénacPCPeggy Cénac
- Pierre-André ZittPZPierre-André Zitt
Open Access
- 1 February 2013
- journal article
- research article
- Published by Bernoulli Society for Mathematical Statistics and Probability in Bernoulli
- Vol. 19 (1) , 18-43
Abstract
With the progress of measurement apparatus and the development of automatic sensors, it is not unusual anymore to get large samples of observations taking values in high-dimension spaces, such as functional spaces. In such large samples of high-dimensional data, outlying curves may not be uncommon, and even a few individuals may corrupt simple statistical indicators, such as the mean trajectory. We focus here on the estimation of the geometric median which is a direct generalization of the real median in metric spaces and has nice robustness properties. It is possible to estimate the geometric median, being defined as the minimizer of a simple convex functional that is differentiable everywhere when the distribution has no atom, with online gradient algorithms. Such algorithms are very fast and can deal with large samples. Furthermore, they also can be simply updated when the data arrive sequentially. We state the almost sure consistency and the $L^{2}$ rates of convergence of the stochastic gradient estimator as well as the asymptotic normality of its averaged version. We get that the asymptotic distribution of the averaged version of the algorithm is the same as the classic estimators, which are based on the minimization of the empirical loss function. The performances of our averaged sequential estimator, both in terms of computation speed and accuracy of the estimations, are evaluated with a small simulation study. Our approach is also illustrated on a sample of more than 5000 individual television audiences measured every second over a period of 24 hours.
Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- Design-based estimation for geometric quantiles with application to outlier detectionComputational Statistics & Data Analysis, 2010
- Robust functional estimation using the median and spherical principal componentsBiometrika, 2008
- Convergent estimators for the l1-median of banach valued random variableStatistics, 2001
- M-estimation, convexity and quantilesThe Annals of Statistics, 1997
- On a Geometric Notion of Quantiles for Multivariate DataJournal of the American Statistical Association, 1996
- Multivariate Location Estimation Using Extension of $R$-Estimates Through $U$-Statistics Type ApproachThe Annals of Statistics, 1992
- Concavity and EstimationThe Annals of Statistics, 1989
- A Newton-Raphson Version of the Multivariate Robbins-Monro ProcedureThe Annals of Statistics, 1985
- Algorithm AS 78: The MediancentreJournal of the Royal Statistical Society Series C: Applied Statistics, 1974
- Note on the median of a multivariate distributionBiometrika, 1948