Self-organisation: a derivation from first principles of a class of learning algorithms

1989 International Joint Conference on Neural Networks 59 citations

Abstract

A novel derivation of T. Kohonen's topographic mapping learning algorithm (Self-Organization and Associative Memory, Springer-Verlag, 1984) is presented. Thus the author prescribes a vector quantizer by minimizing an L/sub 2/ reconstruction distortion measure. He includes in this distribution a contribution from the effect of code noise which corrupts the output of the vector quantizer. Such code noise models the expected distorting effect of later stages of processing, and thus provides a convenient way of ensuring that the vector quantizer acquires a useful coding scheme. The neighborhood updating scheme of Kohonen's self-organizing neural network emerges as a special case of this code noise model. This reformulation of Kohonen's algorithm provides a simple interpretation of the role of the neighborhood update scheme which is used.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Keywords

Self-organizing mapComputer scienceAlgorithmCode (set theory)Noise (video)Associative propertyArtificial neural networkArtificial intelligenceCoding (social sciences)Content-addressable memoryDistortion (music)Class (philosophy)Scheme (mathematics)Theoretical computer scienceMathematicsImage (mathematics)

Related Publications

Fast self-organization by the probing algorithm

A new computational algorithm, the probing algorithm, is introduced for the subproblem of finding the best matching unit in Kohonen's self-organization procedure (Self-Organizat...

1989 International Joint Conference on Neu... 26 citations

Asymptotically optimal block quantization

In 1948 W. R. Bennett used a companding model for nonuniform quantization and proposed the formula <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3...

1979 IEEE Transactions on Information Theory 868 citations

The self-organizing map

The self-organized map, an architecture suggested for artificial neural networks, is explained by presenting simulation experiments and practical applications. The self-organizi...

1990 Proceedings of the IEEE 8017 citations

Publication Info

Year
1989
Type
article
Pages
495-498 vol.2
Citations
59
Access
Closed

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

59
OpenAlex
3
Influential
40
CrossRef

Cite This

S.P. Luttrell (1989). Self-organisation: a derivation from first principles of a class of learning algorithms. International Joint Conference on Neural Networks , 495-498 vol.2. https://doi.org/10.1109/ijcnn.1989.118288

Identifiers

DOI
10.1109/ijcnn.1989.118288

Data Quality

Data completeness: 77%