The error variance of LMS with time-varying weights
Author:
- 1 April 1992
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 40 (4) , 803-813
Abstract
A calculation of weight error variance of the LMS (least mean square) algorithm is made in the presence of time-varying true weights. With time-varying weights the LMS error system has in general several time scales operating at once. This causes difficulties in the variance calculation which seem hitherto to have passed unnoticed. To handle this problem a sort of perturbation expansion is developed based on weak convergence methods or `stochastic averaging'. The main concern in carrying out the error variance calculation is to study the effect on LMS performance of adaptation speed as it relates to true speed of parameter change. Three cases are covered with reference to considering adaptation speed with respect to true speed: first, where the adaptation speed is too slow; second, where it is matched: and third, where it is fasterKeywords
This publication has 12 references indexed in Scilit:
- Adaptation and tracking in system identification—A surveyAutomatica, 1990
- The limiting behavior of LMSIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- Design of adaptive algorithms for the tracking of time‐varying systemsInternational Journal of Adaptive Control and Signal Processing, 1987
- On almost sure convergence of adaptive algorithmsIEEE Transactions on Automatic Control, 1986
- Optimization of adaptive identification for time-varying filtersIEEE Transactions on Automatic Control, 1986
- Second-order convergence analysis of stochastic adaptive linear filteringIEEE Transactions on Automatic Control, 1983
- A measure of the tracking capability of recursive stochastic algorithms with constant gainsIEEE Transactions on Automatic Control, 1982
- Convergence properties of LMS adaptive estimators with unbounded dependent inputs1981
- Performance of adaptive estimation algorithms in dependent random environmentsIEEE Transactions on Automatic Control, 1980
- Lyapunov techniques for the exponential stability of linear difference equations with random coefficientsIEEE Transactions on Automatic Control, 1980