Abstract
An adaptive neural network with asymmetric connections is introduced. This network is related to the Hopfield network with graded neurons and uses a recurrent generalization of the \ensuremath{\delta} rule of Rumelhart, Hinton, and Williams to modify adaptively the synaptic weights. The new network bears a resemblance to the master/slave network of Lapedes and Farber but it is architecturally simpler.
Keywords
GeneralizationHopfield networkArtificial neural networkComputer scienceRecurrent neural networkArtificial intelligenceBackpropagationTypes of artificial neural networksMathematics
Affiliated Institutions
Related Publications
Generalization of Back propagation to Recurrent and Higher Order Neural Networks
A general method for deriving backpropagation algorithms for networks with recurrent and higher order networks is introduced. The propagation of activation in these networks is ...
Long Short-Term Memory
Learning to store information over extended time intervals by recurrent backpropagation takes a very long time, mostly because of insufficient, decaying error backflow. We brief...
Conditional Random Fields as Recurrent Neural Networks
Pixel-level labelling tasks, such as semantic segmentation, play a central role in image understanding. Recent approaches have attempted to harness the capabilities of deep lear...
Learning the hidden structure of speech
In the work described here, the backpropagation neural network learning procedure is applied to the analysis and recognition of speech. This procedure takes a set of input/outpu...
A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures
Recurrent neural networks (RNNs) have been widely adopted in research areas concerned with sequential data, such as text, audio, and video. However, RNNs consisting of sigma cel...
Publication Info
- Year
- 1987
- Type
- article
- Volume
- 59
- Issue
- 19
- Pages
- 2229-2232
- Citations
- 949
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
949
OpenAlex
Cite This
Fernando J. Pineda
(1987).
Generalization of back-propagation to recurrent neural networks.
Physical Review Letters
, 59
(19)
, 2229-2232.
https://doi.org/10.1103/physrevlett.59.2229
Identifiers
- DOI
- 10.1103/physrevlett.59.2229