Adaptive Networks Under Non-Stationary Conditions: Formulation, Performance Analysis, and Application
- 21 May 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 63 (16) , 4300-4314
Abstract
In this paper, we thoroughly investigate the tracking behavior of a wide range of adaptive networks under non-stationary conditions. Under these conditions, we study and analyze the mean-square-error performance of all centralized, incremental, and diffusion algorithms for adaptive networks. The closed forms of the steady-state mean-square deviation (MSD) and excess mean-square error (EMSE) criteria are extracted for these algorithms. In addition, we apply our findings to the time-varying autoregressive (TVAR) modeling problem, which is a significant and common engineering application. Generally, time-varying parameters are extracted from a single-point observation; however, the employment of numerous observations may be necessary in some cases. Therefore, we consider a set of observations in the corresponding model identification problem. It is shown that doing so improves the resolution of the estimated parameters. Moreover, we theoretically examine various types of adaptive algorithms for the TVAR model identification problem. Furthermore, node and network behavior analysis is performed for both transient and steady-state conditions. The analysis proves that regardless of the stationary conditions, neither centralized nor incremental adaptive algorithms dominate universally. However, among diffusion algorithms, the adapt-then-combine (ATC) approach demonstrates superior performance, followed by the combine-then-adapt (CTA) approach and the non-cooperative approach (treated as a special case of the diffusion strategy), in that order. The theoretical findings are well supported by simulation results.Keywords
This publication has 32 references indexed in Scilit:
- On the Kronecker Products and Their ApplicationsJournal of Applied Mathematics, 2013
- Steady-State Analysis of Diffusion LMS Adaptive Networks With Noisy LinksIEEE Transactions on Signal Processing, 2011
- Transient analysis of diffusion least‐mean squares adaptive networks with noisy channelsInternational Journal of Adaptive Control and Signal Processing, 2011
- Steady-State Analysis of Incremental LMS Adaptive Networks With Noisy LinksIEEE Transactions on Signal Processing, 2011
- Analysis of Spatial and Incremental LMS Processing for Distributed EstimationIEEE Transactions on Signal Processing, 2010
- Identification of Time-Varying Autoregressive Systems Using Maximuma PosterioriEstimationIEEE Transactions on Signal Processing, 2008
- Diffusion recursive least-squares for distributed estimation over adaptive networksIEEE Transactions on Signal Processing, 2008
- Monte Carlo Smoothing for Nonlinear Time SeriesJournal of the American Statistical Association, 2004
- Monte Carlo filtering and smoothing with application to time-varying spectral estimation2002
- Transient and tracking performance analysis of the quantized LMS algorithm for time-varying system identificationIEEE Transactions on Signal Processing, 1996