Stochastic approximation: invited paper
Author:
- Tze Leung LaiTLTze Leung Lai
Open Access
- 1 April 2003
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 31 (2) , 391-406
Abstract
Stochastic approximation, introduced by Robbins and Monro in 1951, has become an important and vibrant subject in optimization, control and signal processing. This paper reviews Robbins' contributions to stochastic approximation and gives an overview of several related developments.Keywords
This publication has 52 references indexed in Scilit:
- Recent progress in parallel stochastic approximations2005
- Multivariate Adaptive Stochastic ApproximationThe Annals of Statistics, 1987
- Least Squares Estimates in Stochastic Regression Models with Applications to Identification and Control of Dynamic SystemsThe Annals of Statistics, 1982
- Indirect stochastic adaptive control: The general delay-white noise caseIEEE Transactions on Automatic Control, 1982
- Analysis of recursive stochastic algorithmsIEEE Transactions on Automatic Control, 1977
- Asymptotic Distribution of Stochastic Approximation ProceduresThe Annals of Mathematical Statistics, 1958
- Approximation Methods which Converge with Probability oneThe Annals of Mathematical Statistics, 1954
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951
- A Method for Obtaining and Analyzing Sensitivity DataJournal of the American Statistical Association, 1948
- Experimental Determination of the Maximum of a FunctionThe Annals of Mathematical Statistics, 1941