Abstract
Support Vector Machines (SVMs) are a popular data classification method with many diverse applications. The SVMs performance depends on choice a suitable kernel function for a given problem. Using an appropriate kernel; the data are transform into a space with higher dimension in which they are separable by an hyperplane. A major challenges of SVMs are how to select an appropriate kernel and how to find near optimal values of its parameters. Usually a single kernel is used by most studies, but the real world applications may required a combination of multiple kernels. In this paper, a new method called, weighted powered kernels for data classification is proposed. The proposed method combined three kernels to produce a new combined kernel (WPK). The method used Scatter Search approach to find near optimal values of weights, alphas and kernels parameters which associated with each kernel. To evaluate the performance of the proposed method, 11 benchmark are used. Experiments and comparisons prove that the method given acceptable outcomes and has a competitive performance relative to a single kernel and some other published methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abbasnejad, M.E., Ramachandram, D., Mandava, R.: A survey of the state of the art in learning the kernels. Knowledge and Information Systems 31(2), 193–221 (2012)
Burges, C.J.: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)
Lin, C.-J., Chang, C.-C.: Libsvm: a library for support vector machines, http://www.csie.ntu.edu.tw/~cjlin/libsvm (visted in February 5, 2012)
Chen, S.C., Linb, S.W., Chou, S.Y.: Enhancing the classification accuracy by scatter-based ensemble approach. Applied Soft Computing, 1–8 (2010)
Dioşan, L., Oltean, M., Rogozan, A.: Improving SVM Performance Using a Linear Combination of Kernels. In: Beliczynski, B., Dzielinski, A., Iwanowski, M., Ribeiro, B. (eds.) ICANNGA 2007, Part II. LNCS, vol. 4432, pp. 218–227. Springer, Heidelberg (2007)
Diosan, L., Rogozan, A., Pecuchet, J.-P.: Improving classification performance of support vector machine by genetically optimising kernel shape and hyper-parameters. Applied Intelligence 36(2), 280–294 (2012)
Fielding, A.H.: Cluster and Classification Techniques for the Biosciences. Cambridge University Press (2007)
Gordon, A.D.: Classification. Chapman& Hall/CRC (1999)
Hsu-Wei, C., Chang, C.-C., Lin, C.-J.: A practical guide to support vector classification. Technical Report, Department of Computer science, National Taiwan University, pp. 1–12 (2003)
Huang, C.-L., Wang, C.-J.: A ga-based feature selection and parameters optimization for support vector machines. Expert Systems with Applications 31, 231–240 (2006)
Jia, Z.-Y., Ma, J.-W., Wang, F.-J., Liu, W.: Hybrid of simulated annealing and svm for hydraulic valve characteristics prediction. Expert Systems with Applications 38, 8030–8036 (2011)
Jiang, Y., Tang, C., Li, C., Li, S., Zheng, H.: Automatic svm kernel function construction based on gene expression programming. In: Proceedings of Inernational Conference on Computer Science and Software Engineering (2008)
Joachims, T.: Learning to classify texts using support vector machines: methods, theory and algorithms. Kluwer Academic Publishers, Dordrecht (2002)
Laguna, M., Marti, R.: Scatter search methodology and implementations in C. Kluwer Academic (2003)
Li-Xia, L., Yi-Qi, Z., Xue-Yong, L.: Tax forecasting theory and model based on svm optimized by pso. Expert Systems with Applications 38, 116–120 (2011)
Lin, S.W., Chen, S.C., Lin, K.C., Lee, Z.J.: Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Systems with Applications 35, 1817–1824 (2008)
Marti, R., Laguna, M., Glover, F.: Principles of scatter search. Operational Research 169, 359–372 (2006)
Marti, R., Laguna, M., Glover, F., Campos, V.: An experimental evaluation of a scatter search for the linear ordering problem. Global Optimization 21, 397–414 (2001)
Nobel, W.S.: Support vector machine applications in computational biology. In: Schoekkopf, B., Tsuda, K., Vert, J.-P. (eds.) Kernel Methods in Computational Biology, pp. 71–92. MIT Press, Cambridge (2004)
Palaniswami, M., Shilton, A., Ralph, D., Owen, B.D.: Machine learning using support vector machines. In: Proceedings of International Conference on Artificial Intelligence in Science and Technology (2000)
Ren, Y., Bai, G.: Determination of optimal svm parameters by using ga/pso. Journal of Computers 5(8), 1160–1168 (2010)
Samadzadegan, F., Soleymani, A., Abbaspour, R.A.: Evaluation of genetic algorithm for tuning svm parameters in multi-class problems. In: CINTI 2010 - 11th IEEE International Symposium on Computational Intelligence and Informatics, pp. 323–327 (2010)
Sartakhti, J.S., Zangooei, M.H., Mozafari, K.: Hepatitis disease diagnosis using a novel hybrid method based on support vector machine and simulated annealing (svm-sa). Computer Methods and Programs in Biomedisine, 1–10 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Afif, M.H., Hedar, AR., Hamid, T.H.A., Mahdy, Y.B. (2012). Support Vector Machines with Weighted Powered Kernels for Data Classification. In: Hassanien, A.E., Salem, AB.M., Ramadan, R., Kim, Th. (eds) Advanced Machine Learning Technologies and Applications. AMLTA 2012. Communications in Computer and Information Science, vol 322. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35326-0_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-35326-0_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35325-3
Online ISBN: 978-3-642-35326-0
eBook Packages: Computer ScienceComputer Science (R0)