Fast adaptive digital equalization by recurrent neural networks
Authors:
- E.D. Di ClaudioECE.D. Di Claudio
- G. OrlandiGOG. Orlandi
- B.D. RaoBRB.D. Rao
- 1 November 1997
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 45 (11) , 2731-2739
Abstract
Neural networks (NNs) have been extensively applied to many signal processing problems. In particular, due to their capacity to form complex decision regions, NNs have been successfully used in adaptive equalization of digital communication channels. The mean square error (MSE) criterion, which is usually adopted in neural learning, is not directly related to the minimization of the classification error, i.e., bit error rate (BER), which is of interest in channel equalization. Moreover, common gradient-based learning techniques are often characterized by slow speed of convergence and numerical ill conditioning. In this paper, we introduce a novel approach to learning in recurrent neural networks (RNNs) that exploits the principle of discriminative learning, minimizing an error functional that is a direct measure of the classification error. The proposed method extends to RNNs a technique applied with success to fast learning of feedforward NNs and is based on the descent of the error functional in the space of the linear combinations of the neurons (the neuron space); its main features are higher speed of convergence and better numerical conditioning w.r.t. gradient-based approaches, whereas numerical stability is assured by the use of robust least squares solvers. Experiments regarding the equalization of PAM signals in different transmission channels are described, which demonstrate the effectiveness of the proposed approach.Keywords
This publication has 22 references indexed in Scilit:
- A generalized learning paradigm exploiting the structure of feedforward neural networksIEEE Transactions on Neural Networks, 1996
- Recursive least squares approach to learning in recurrent neural networks1996
- Gradient calculations for dynamic recurrent neural networks: a surveyIEEE Transactions on Neural Networks, 1995
- Adaptive decision feedback equalization for digital satellite channels using multilayer neural networksIEEE Journal on Selected Areas in Communications, 1995
- The complex backpropagation algorithmIEEE Transactions on Signal Processing, 1991
- The application of nonlinear structures to the reconstruction of binary signalsIEEE Transactions on Signal Processing, 1991
- Optimal weighted LS AR estimation in presence of impulsive noise1991
- An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network TrajectoriesNeural Computation, 1990
- Adaptive equalization of finite non-linear channels using multilayer perceptronsSignal Processing, 1990
- Finding structure in timeCognitive Science, 1990