The Influence of Supervised Clustering for RBFNN Centers Definition: A Comparative Study
Several clustering algorithms have been considered to determine the centers and dispersions of the hidden layer neurons of Radial Basis Function Neural Networks (RBFNNs) when applied both to regression and classification tasks. Most of the proposed approaches use unsupervised clustering techniques. However, for data classification, by performing supervised clustering it is expected that the obtained clusters represent meaningful aspects of the dataset. We therefore compared the original versions of k-means, Neural-Gas (NG) and Adaptive Radius Immune Algorithm (ARIA) along with their variants that use labeled information. The first two had already supervised versions in the literature, and we extended ARIA toward a supervised version. Artificial and real-world datasets were considered in our experiments and the results showed that supervised clustering is better indicated in problems with unbalanced and overlapping classes, and also when the number of input features is high.
KeywordsRadial Basis Function Clustering Adaptive Radius Immune Algorithm Supervised Learning for Data Classification
Unable to display preview. Download preview PDF.
- 1.Barra, T., Bezerra, G., de Castro, L., Von Zuben, F.: An Immunological Density-Preserving Approach to the Synthesis of RBF Neural Networks for Classification. In: IEEE International Joint Conference on Neural Networks, pp. 929–935 (2006)Google Scholar
- 4.Cevikalp, H., Larlus, D., Jurie, F.: A supervised clustering algorithm for the initialization of RBF neural network classifiers. In: 15th IEEE Signal Processing and Communications Applications, pp. 1–4 (2007)Google Scholar
- 5.Frank, A., Asuncion, A.: UCI machine learning repository (2010), http://archive.ics.uci.edu/ml
- 6.Gan, M., Peng, H., Dong, X.: A hybrid algorithm to optimize RBF network architecture and parameters for nonlinear time series modeling. Applied Mathematical Modelling (2011)Google Scholar
- 8.Haykin, S.: Neural Networks: A Comprehensive Foundation. Prentice-Hall (1999)Google Scholar
- 9.Lamirel, J., Mall, R., Cuxac, P., Safi, G.: Variations to incremental growing neural gas algorithm based on label maximization. In: IEEE International Joint Conference on Neural Networks (IJCNN), pp. 956–965 (2011)Google Scholar
- 11.Okamoto, K., Ozawa, S., Abe, S.: A Fast Incremental Learning Algorithm of RBF Networks with Long-Term Memory. In: Proceedings of the International Joint Conference on Neural Networks, pp. 102–107 (2003)Google Scholar
- 14.Veroneze, R., Gonçalves, A.R., Von Zuben, F.J.: A Multiobjective Analysis of Adaptive Clustering Algorithms for the Definition of RBF Neural Network Centers in Regression Problems. In: Yin, H., Costa, J.A.F., Barreto, G. (eds.) IDEAL 2012. LNCS, vol. 7435, pp. 127–134. Springer, Heidelberg (2012)CrossRefGoogle Scholar
- 15.Wang, X., Syrmos, V.: Optimal cluster selection based on Fisher class separability measure. In: Proceedings of American Control Conference, pp. 1929–1934 (2005)Google Scholar