Discrete-time backpropagation for training synaptic delay-based artificial neural networks
- 1 July 1999
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 10 (4) , 779-789
Abstract
The aim of this paper is to endow a well-known structure for processing time-dependent information, synaptic delay-based ANN's, with a reliable and easy to implement algorithm suitable for training temporal decision processes. In fact, we extend the backpropagation algorithm to discrete-time feedforward networks that include adaptable internal time delays in the synapses. The structure of the network is similar to the one presented by [1], that is, in addition to the weights modeling the transmission capabilities of the synaptic connections, we model their length by means of a parameter that indicates the delay a discrete-event suffers when going from Zthe origin neuron to the target neuron through a synaptic connection. Like the weights, these delays are also trainable, and a training algorithm can be derived that is almost as simple as the backpropagation algorithm, and which is really an extension of it. We present examples of the application of these networks and algorithm to the prediction of time series and to the recognition of patterns in electrocardiographic signals. In the first case, we employ the temporal reasoning characteristics of these networks for the prediction of future values in a benchmark example of a time series: the one governed by the Mackey-Glass chaotic equation. In the second case, we provide a real life example. The problem consists in identifying different types of beats through two levels of temporal processing, one relating the morphological features which make up the beat in time and another one that relates the positions of beats in time, that is, considers rhythm characteristics of the ECG signal. In order to do this, the network receives the signal sequentially, no windowing, segmentation, or thresholding are applied.Keywords
This publication has 15 references indexed in Scilit:
- An improved time series prediction by applying the layer-by-layer learning method to FIR neural networksNeural Networks, 1997
- Performance enhancement using nonlinear preprocessingIEEE Transactions on Neural Networks, 1996
- Evolving recurrent perceptrons for time-series modelingIEEE Transactions on Neural Networks, 1994
- Syntactic pattern recognition of the ECGIEEE Transactions on Pattern Analysis and Machine Intelligence, 1990
- Algorithmic sequential decision-making in the frequency domain for life threatening ventricular arrhythmias and imitative artefacts: a diagnostic systemJournal of Biomedical Engineering, 1989
- Phoneme recognition using time-delay neural networksIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- Syntactic ECG processing: A reviewPattern Recognition, 1986
- An attribute grammar for QRS detectionPattern Recognition, 1986
- Syntactic Approach to ECG Rhythm AnalysisIEEE Transactions on Biomedical Engineering, 1980
- Oscillation and Chaos in Physiological Control SystemsScience, 1977