Rival-Model Penalized Self-Organizing Map
Authors:
- 2 January 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 18 (1) , 289-295
Abstract
As a typical data visualization technique, self-organizing map (SOM) has been extensively applied to data clustering, image analysis, dimension reduction, and so forth. In a conventional adaptive SOM, it needs to choose an appropriate learning rate whose value is monotonically reduced over time to ensure the convergence of the map, meanwhile being kept large enough so that the map is able to gradually learn the data topology. Otherwise, the SOM's performance may seriously deteriorate. In general, it is nontrivial to choose an appropriate monotonically decreasing function for such a learning rate. In this letter, we therefore propose a novel rival-model penalized self-organizing map (RPSOM) learning algorithm that, for each input, adaptively chooses several rivals of the best-matching unit (BMU) and penalizes their associated models, i.e., those parametric real vectors with the same dimension as the input vectors, a little far away from the input. Compared to the existing methods, this RPSOM utilizes a constant learning rate to circumvent the awkward selection of a monotonically decreased function for the learning rate, but still reaches a robust result. The numerical experiments have shown the efficacy of our algorithmKeywords
This publication has 12 references indexed in Scilit:
- Rival penalization controlled competitive learning for data clustering with unknown cluster number2004
- Things you haven't heard about the self-organizing map2002
- Self-Organizing Maps2001
- SOM-based data visualization methodsIntelligent Data Analysis: An International Journal, 1999
- Application of tree structured self-organizing maps in content-based image retrieval1999
- Self-Organizing Maps of Very Large Document Collections: Justification for the WEBSOM Method1998
- Self-organizing feature map with a momentum termNeurocomputing, 1996
- Rival penalized competitive learning for clustering analysis, RBF net, and curve detectionIEEE Transactions on Neural Networks, 1993
- On the issue of neighborhood in self-organizing maps1992
- THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMSAnnals of Eugenics, 1936