Self-Organizing Maps with Asymmetric Neighborhood Function
- 1 September 2007
- journal article
- Published by MIT Press in Neural Computation
- Vol. 19 (9) , 2515-2535
Abstract
The self-organizing map (SOM) is an unsupervised learning method as well as a type of nonlinear principal component analysis that forms a topologically ordered mapping from the high-dimensional data space to a low-dimensional representation space. It has recently found wide applications in such areas as visualization, classification, and mining of various data. However, when the data sets to be processed are very large, a copious amount of time is often required to train the map, which seems to restrict the range of putative applications. One of the major culprits for this slow ordering time is that a kind of topological defect (e.g., a kink in one dimension or a twist in two dimensions) gets created in the map during training. Once such a defect appears in the map during training, the ordered map cannot be obtained until the defect is eliminated, for which the number of iterations required is typically several times larger than in the absence of the defect. In order to overcome this weakness, we propose that an asymmetric neighborhood function be used for the SOM algorithm. Compared with the commonly used symmetric neighborhood function, we found that an asymmetric neighborhood function accelerates the ordering process of the SOM algorithm, though this asymmetry tends to distort the generated ordered map. We demonstrate that the distortion of the map can be suppressed by improving the asymmetric neighborhood function SOM algorithm. The number of learning steps required for perfect ordering in the case of the one-dimensional SOM is numerically shown to be reduced from O(N3) to O(N2) with an asymmetric neighborhood function, even when the improved algorithm is used to get the final map without distortion.Keywords
This publication has 9 references indexed in Scilit:
- Magnification Control in Self-Organizing Maps and Neural GasNeural Computation, 2006
- Time behavior of topological ordering in self-organizing feature mappingBiological Cybernetics, 1997
- Self-organizing maps: stationary states, metastability and convergence rateBiological Cybernetics, 1992
- Asymptotic level density for a class of vector quantization processesIEEE Transactions on Neural Networks, 1991
- On the stationary state of Kohonen's self-organizing sensory mappingBiological Cybernetics, 1986
- Self-organized formation of topologically correct feature mapsBiological Cybernetics, 1982
- Sequence regularity and geometry of orientation columns in the monkey striate cortexJournal of Comparative Neurology, 1974
- Self-organization of orientation sensitive cells in the striate cortexBiological Cybernetics, 1973
- Receptive fields, binocular interaction and functional architecture in the cat's visual cortexThe Journal of Physiology, 1962