Abstract
Computational properties of use of biological organisms or to the construction of computers can emerge as collective properties of systems having a large number of simple equivalent components (or neurons). The physical meaning of content-addressable memory is described by an appropriate phase space flow of the state of a system. A model of such a system is given, based on aspects of neurobiology but readily adapted to integrated circuits. The collective properties of this model produce a content-addressable memory which correctly yields an entire memory from any subpart of sufficient size. The algorithm for the time evolution of the state of the system is based on asynchronous parallel processing. Additional emergent collective properties include some capacity for generalization, familiarity recognition, categorization, error correction, and time sequence retention. The collective properties are only weakly sensitive to details of the modeling or the failure of individual devices.
Keywords
Computer scienceAsynchronous communicationCollective behaviorGeneralizationSimple (philosophy)CategorizationContent-addressable memoryNeural systemArtificial neural networkPhysical systemState spaceMeaning (existential)Theoretical computer scienceArtificial intelligenceCognitive scienceNeurosciencePsychology
MeSH Terms
AnimalsComputersMathematicsMemoryModelsNeurologicalNeurons
Related Publications
Generalization of Back propagation to Recurrent and Higher Order Neural Networks
A general method for deriving backpropagation algorithms for networks with recurrent and higher order networks is introduced. The propagation of activation in these networks is ...
A scalable content-addressable network
Hash tables - which map "keys" onto "values" - are an essential building block in modern software systems. We believe a similar functionality would be equally valuable to large ...
Parallel networks that learn to pronounce English text
This paper describes NETtalk, a class of massively-parallel network systems that learn to convert English text to speech. The memory representations for pronunciations are learn...
An Improved Spectral Graph Partitioning Algorithm for Mapping Parallel Computations
Efficient use of a distributed memory parallel computer requires that the computational load be balanced across processors in a way that minimizes interprocessor communication. ...
INFORMATION THEORY AND STIMULUS‐INDEPENDENT THOUGHT
The production of stimulus‐independent thought (e.g. fantasy and imagery) was measured as a function of the rate at which information was presented to human subjects. Informatio...
Publication Info
- Year
- 1982
- Type
- article
- Volume
- 79
- Issue
- 8
- Pages
- 2554-2558
- Citations
- 18877
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
18877
OpenAlex
951
Influential
Cite This
J. J. Hopfield
(1982).
Neural networks and physical systems with emergent collective computational abilities..
Proceedings of the National Academy of Sciences
, 79
(8)
, 2554-2558.
https://doi.org/10.1073/pnas.79.8.2554
Identifiers
- DOI
- 10.1073/pnas.79.8.2554
- PMID
- 6953413
- PMCID
- PMC346238