Stochastic gradient identification of Wiener system with maximum mutual information criterion
Authors:
- 12 September 2011
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Signal Processing
- Vol. 5 (6) , 589-597
Abstract
This study presents an information-theoretic approach for adaptive identification of an unknown Wiener system. A two-criterion identification scheme is proposed, in which the adaptive system comprises a linear finite-impulse response filter trained by maximum mutual information (MaxMI) criterion and a polynomial non-linearity learned by traditional mean square error criterion. The authors show that under certain conditions, the optimum solution matches the true system exactly. Further, the authors develop a stochastic gradient-based algorithm, that is, stochastic mutual information gradient–normalised least mean square algorithm, to implement the proposed identification scheme. Monte-Carlo simulation results demonstrate the noticeable performance improvement of this new algorithm in comparison with some other algorithms.Keywords
This publication has 18 references indexed in Scilit:
- Adaptive filtering under minimum information divergence criterionInternational Journal of Control, Automation, and Systems, 2009
- Adaptive filtering under maximum mutual information criterionNeurocomputing, 2008
- A minimum-error entropy criterion with self-adjusting step-size (MEE-SAS)Signal Processing, 2007
- Generalized information potential criterion for adaptive system trainingIEEE Transactions on Neural Networks, 2002
- Stochastic gradient identification of polynomial Wiener systems: analysis and applicationIEEE Transactions on Signal Processing, 2001
- Stochastic analysis of gradient adaptive identification of nonlinear systems with memory for Gaussian data and noisy input and output measurementsIEEE Transactions on Signal Processing, 1999
- Nonparametric approach to Wiener system identificationIEEE Transactions on Circuits and Systems I: Regular Papers, 1997
- Least mean p-power error criterion for adaptive FIR filterIEEE Journal on Selected Areas in Communications, 1994
- Entropy Optimization Principles and Their Applications1992
- The least mean fourth (LMF) adaptive algorithm and its familyIEEE Transactions on Information Theory, 1984