Abstract
Although there is a large diversity in the literature related to kernel methods, there are only a few works which do not use kernels based on Radial Basis Functions (RBF) for regression problems. The reason for that is that they present very good generalization capabilities and smooth interpolation. This paper studies an initial framework to create specific-to-problem kernels for application to regression models. The kernels are created without prior knowledge about the data to be approximated by means of a Genetic Programming algorithm. The quality of a kernel is evaluated independently of a particular model, using a modified version of a non parametric noise estimator. For a particular problem, performances of generated kernels are tested against common ones using weighted k-nn in the kernel space. Results show that the presented method produces specific-to-problem kernels that outperform the common ones for this particular case. Parallel programming is utilized to deal with large computational costs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Suykens, J.A.K., Van Gestel, T., De Brabanter, J., De Moor, B., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific Publishing, Singapore (2002)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press, Cambridge (2005)
Rubio, G., Guillen, A., Herrera, L.J., Pomares, H., Rojas, I.: Use of specific-to-problem kernel functions for time series modeling. In: ESTSP 2008: Proceedings of the European Symposium on Time Series Prediction, pp. 177–186 (2008)
Koza, J.: Genetic Programming. MIT Press, Cambridge (1992)
Rubio, G., Pomares, H., Rojas, I., Guillén, A.: A basic approach to reduce the complexity of a self-generated fuzzy rule-table for function approximation by use of symbolic regression in 1d and 2d cases. In: IWINAC (2), pp. 143–152 (2005)
Rubio, G., Pomares, H.: A basic approach to reduce the complexity of a self-generated fuzzy rule-table for function approximation by use of symbolic interpolation. In: Cabestany, J., Prieto, A.G., Sandoval, F. (eds.) IWANN 2005. LNCS, vol. 3512, pp. 34–41. Springer, Heidelberg (2005)
Howley, T., Madden, M.: The genetic kernel support vector machine: Description and evaluation. Artificial Intelligence Review 24, 379–395 (2005)
Gagné, C., Schoenauer, M., Sebag, M., Tomassini, M.: Genetic programming for kernel-based learning with co-evolving subsets selection. DANS PPSN 06, 1008 (2006)
Methasate, I., Theeramunkong, T.: Kernel Trees for Support Vector Machines. IEICE Trans. Inf. Syst. E90-D(10), 1550–1556 (2007)
Sullivan, K.M., Luke, S.: Evolving kernels for support vector machine classification. In: GECCO 2007: Proceedings of the 9th annual conference on Genetic and evolutionary computation, pp. 1702–1707. ACM Press, New York (2007)
Diosan, L., Rogozan, A., Pecuchet, J.P.: Evolving kernel functions for svms by genetic programming. In: ICMLA 2007: Proceedings of the Sixth International Conference on Machine Learning and Applications, Washington, DC, USA, pp. 19–24. IEEE Computer Society Press, Los Alamitos (2007)
Lendasse, A., Corona, F., Hao, J., Reyhani, N., Verleysenp, M.: Determination of the mahalanobis matrix using nonparametric noise estimations. In: ESANN, pp. 227–232 (2006)
Koza, J.R.: A genetic approach to the truck backer upper problem and the inter-twined spiral problem. In: Proceedings of IJCNN International Joint Conference on Neural Networks, vol. IV, pp. 310–318. IEEE Press, Los Alamitos (1992)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning . Addison-Wesley, New York (1989)
Mladenović, N., Hansen, P.: Variable neighborhood search. Comps. in Opns. Res. 24, 1097–1100 (1997)
Guillén, A.: MATLAB Interface for Sun MPI functions, http://atc.ugr.es/~aguillen/MPI/MPI_MATLAB.htm
Guillen, A., Rojas, I., Rubio, G., Pomares, H., Herrera, L.J., Gonzalez, J.: A new interface for mpi in matlab and its application over a genetic algorithm. In: ESTSP 2008: Proceedings of the European Symposium on Time Series Prediction, pp. 37–46 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rubio, G., Pomares, H., Rojas, I., Guillén, A. (2009). Creation of Specific-to-Problem Kernel Functions for Function Approximation. In: Cabestany, J., Sandoval, F., Prieto, A., Corchado, J.M. (eds) Bio-Inspired Systems: Computational and Ambient Intelligence. IWANN 2009. Lecture Notes in Computer Science, vol 5517. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02478-8_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-02478-8_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02477-1
Online ISBN: 978-3-642-02478-8
eBook Packages: Computer ScienceComputer Science (R0)