Abstract
The usual way to learn radial basis function (RBF) networks consists of two stages: first, select reasonable weights between input and hidden layers, and then optimize weights between hidden and output layers. When we learn multilayer perceptrons (MLPs), we usually employ the stochastic descent called backpropagation (BP) algorithm or 2nd-order methods such as pseudo-Newton method and conjugate gradient method. Recently new learning methods called singularity stairs following (SSF) methods have been proposed for learning real-valued or complex-valued MLPs by making good use of singular regions. SSF can monotonically decrease training error along with the increase of hidden units, and stably find a series of excellent solutions. This paper proposes a completely new method for learning RBF networks by introducing the SSF paradigm, and compares its performance with those of existing learning methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
UCI Machine Learning Repository (1996). http://archive.ics.uci.edu/ml/
Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon Press, Oxford (1995)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum-likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39, 1–38 (1977)
Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, Hoboken (1987)
Fukumizu, K., Amari, S.: Local minima and plateaus in hierarchical structure of multilayer perceptrons. Neural Netw. 13(3), 317–327 (2000)
Là zaro, M., Santamarìa, I., Pantaleòn, C.: A new EM-based training algorithm for RBF networks. Neural Netw. 16, 69–77 (2003)
Little, M.A., McSharry, P.E., Roberts, S.J., Costello, D.A.E., Moroz, I.M.: Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. OnLine 6, 23 (2007)
Nitta, T.: Local minima in hierarchical structures of complex-valued neural networks. Neural Netw. 43, 1–7 (2013)
Satoh, S., Nakano, R.: Multilayer perceptron learning utilizing singular regions and search pruning. In: Proceedings of International Conference on Machine Learning and Data Analysis, pp. 790–795 (2013)
Satoh, S., Nakano, R.: A yet faster version of complex-valued multilayer perceptron learning using singular regions and search pruning. In: Proceedings of 7th International Joint Conference on Computational Intelligence (IJCCI), NCTA, vol. 3, pp. 122–129 (2015)
Acknowledgment
This work was supported by Grants-in-Aid for Scientific Research (C) 16K00342.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Satoh, S., Nakano, R. (2018). A New Method for Learning RBF Networks by Utilizing Singular Regions. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J. (eds) Artificial Intelligence and Soft Computing. ICAISC 2018. Lecture Notes in Computer Science(), vol 10841. Springer, Cham. https://doi.org/10.1007/978-3-319-91253-0_21
Download citation
DOI: https://doi.org/10.1007/978-3-319-91253-0_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91252-3
Online ISBN: 978-3-319-91253-0
eBook Packages: Computer ScienceComputer Science (R0)