Abstract
We review the recently proposed method of Kernel Self-organising maps (KSOM) which has been shown to exhibit very fast convergence. We show that this is due to an interaction between the fact that we are working in an overcomplete basis and the fact that we are using a mixture of one-shot and incremental learning. We then review Relevance Vector Machines which is a supervised training method related to Support Vector Machines and apply it to creating the Relevance Self-Organising Map, RSOM. We show results on artificial data and on the iris data set.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. MacDonald and C. Fyfe. The kernel self-organising map. In R.J. Howlett and L. C. Jain, editors, Fourth International Conference on Knowledge-based Intelligent Engineering Systems and Allied Technologies, KES2000, 2000.
D. Michie, D. J. Spiegelhalter, and C. C. Taylor, editors. Machine learning, neural and statistical classification. Ellis Horwood, 1994.
B. Schölkopf. The kernel trick for distances. Technical report, Microsoft Research, May 2000.
B. Schölkopf, A. Smola, and K.-R. Muller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299–1319, 1998.
A. J. Smola, S. Mika, B. Schölkopf, and R. C. Williamson. Regularized principal maniforlds. Machine Learning, pages 1–28, 2000.
M. Tipping. The relevance vector machine. In S. A. Solla, T. K. Leen, and K.-R. Muller, editors, Advances in Neural Information Processing Systems, 12. MIT Press, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Corchado, E., Fyfe, C. (2003). Relevance and Kernel Self-Organising Maps. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. ICANN ICONIP 2003 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44989-2_34
Download citation
DOI: https://doi.org/10.1007/3-540-44989-2_34
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40408-8
Online ISBN: 978-3-540-44989-8
eBook Packages: Springer Book Archive