Abstract
A model for a large network of "neurons" with a graded response (or sigmoid input-output relation) is studied. This deterministic system has collective properties in very close correspondence with the earlier stochastic model based on McCulloch - Pitts neurons. The content- addressable memory and other emergent collective properties of the original model also are present in the graded response model. The idea that such collective properties are used in biological systems is given added credence by the continued presence of such properties for more nearly biological "neurons." Collective analog electrical circuits of the kind described will certainly function. The collective states of the two models have a simple correspondence. The original model will continue to be useful for simulations, because its connection to graded response systems is established. Equations that include the effect of action potentials in the graded response system are also developed.
Keywords
Sigmoid functionSimple (philosophy)Biological systemStatistical physicsComputer scienceFunction (biology)Collective behaviorCredenceConnection (principal bundle)NeuroscienceMathematicsPhysicsArtificial intelligenceArtificial neural networkBiologyMachine learning
Affiliated Institutions
Related Publications
Generalization of Back propagation to Recurrent and Higher Order Neural Networks
A general method for deriving backpropagation algorithms for networks with recurrent and higher order networks is introduced. The propagation of activation in these networks is ...
INFORMATION THEORY AND STIMULUS‐INDEPENDENT THOUGHT
The production of stimulus‐independent thought (e.g. fantasy and imagery) was measured as a function of the rate at which information was presented to human subjects. Informatio...
A Linear Spatial Correlation Model, with Applications to Positron Emission Tomography
Abstract A simple spatial-correlation model is presented for repeated measures data. Correlation between observations on the same subject is assumed to decay as a linear functio...
Consensus and Cooperation in Networked Multi-Agent Systems
<para xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> This paper provides a theoretical framework for analysis of consensus algorithms...
Optical Velocity Patterns, Velocity-Sensitive Neurons, and Space Perception: A Hypothesis
A hypothesis is put forward of how global patterns of optical flow, as discussed by Gibson, Johansson, and others, could be processed by relatively simple physiological mechanis...
Publication Info
- Year
- 1984
- Type
- article
- Volume
- 81
- Issue
- 10
- Pages
- 3088-3092
- Citations
- 6842
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
6842
OpenAlex
Cite This
J. J. Hopfield
(1984).
Neurons with graded response have collective computational properties like those of two-state neurons..
Proceedings of the National Academy of Sciences
, 81
(10)
, 3088-3092.
https://doi.org/10.1073/pnas.81.10.3088
Identifiers
- DOI
- 10.1073/pnas.81.10.3088