Abstract
Least Square Support Vector Machines (LSSVMs) are an alternative to SVMs because the training process of LSSVM classifiers only requires to solve a linear equation system instead of solving a quadratic programming optimization problem. Nevertheless, the absence of sparseness in the solution (i.e. the Lagrange multipliers vector) obtained is a significant drawback which must be overcome. This work presents a new approach to building Sparse Least Square Support Vector Machines with fixed-size of support vectors for classification tasks. Our proposal named FSGAS-LSSVM relies on a binary-encoding single-objective genetic algorithms, in which the standard reproduction and mutation operators must be modified. The main idea is to leave a few support vectors out of the solution without affecting the classifier’s accuracy and even improving it. In our proposal, GAs are used to select a suitable fixed-size set of support vectors by removing non-relevant patterns or those ones, which can be corrupted with noise and thus prevent classifiers to achieve higher accuracies.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aydin, I., Karakose, M., Akin, E.: A multi-objective artificial immune algorithm for parameter optimization in svm. Applied Soft Computing 11(1), 120–129 (2011)
Blachnik, M., Kordos, M.: Simplifying SVM with weighted LVQ algorithm. In: Yin, H., Wang, W., Rayward-Smith, V. (eds.) IDEAL 2011. LNCS, vol. 6936, pp. 212–219. Springer, Heidelberg (2011)
Burges, C.J.C.: Simplified support vector decision rules. In: Proceedings of the 13th (ICML 1996). pp. 71–77. Morgan Kaufmann (1996)
Carvalho, B.P.R., Braga, A.P.: IP-LSSVM: A two-step sparse classifier. Pattern Recognition Letters 30, 1507–1515 (2009)
D’Amato, L., Moreno, J.A., Mujica, R.: Reducing the complexity of kernel machines with neural growing gas in feature space. In: Lemaître, C., Reyes, C.A., González, J.A. (eds.) IBERAMIA 2004. LNCS (LNAI), vol. 3315, pp. 799–808. Springer, Heidelberg (2004)
Eiben, A., Smith, J.: Introduction to Evolutionary Computation. Springer (2003)
Geebelen, D., Suykens, J.A.K., Vandewalle, J.: Reducing the number of support vectors of SVM classifiers using the smoothed separable case approximation. IEEE Transactions on Neural Network and Learning Systems 23(4), 682–688 (2012)
Li, Y., Lin, C., Zhang, W.: Improved sparse least-squares support vector machine classifiers. Neurocomputing 69, 1655–1658 (2006)
Peres, R., Pedreira, C.E.: Generalized risk zone: Selecting observations for classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(7), 1331–1337 (2009)
Neto, A.R.R., Barreto, G.A.: Opposite maps: Vector quantization algorithms for building reduced-set SVM and LSSVM classifiers. Neural Processing Letters 37(1), 3–19 (2013)
Samadzadegan, F., Soleymani, A., Abbaspour, R.: Evaluation of genetic algorithms for tuning svm parameters in multi-class problems. In: 11th International Symposium on Computational Intelligence and Informatics (CINTI), pp. 323–328 (2010)
Silva, D.A., Rocha Neto, A.R.: Multi-objective genetic algorithms for sparse least square support vector machines. In: Corchado, E., Lozano, J.A., Quintián, H., Yin, H. (eds.) IDEAL 2014. LNCS, vol. 8669, pp. 158–166. Springer, Heidelberg (2014)
Steinwart, I.: Sparseness of support vector machines. Journal of Machine Learning Research 4, 1071–1105 (2003)
Suykens, J.A.K., Lukas, L., Vandewalle, J.: Sparse least squares support vector machine classifiers. In: Proceedings of the 8th European Symposium on Artificial Neural Networks (ESANN 2000), pp. 37–42 (2000)
Suykens, J.A.K., Vandewalle, J.: Least squares support vector machine classifiers. Neural Processing Letters 9(3), 293–300 (1999)
Valyon, J., Horvath, G.: A sparse least squares support vector machine classifier. In: IEEE IJCNN, 2004. vol. 1, p. 548 (2004)
Vapnik, V.N.: Statistical Learning Theory. Wiley-Interscience (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Silva, D.A., Rocha Neto, A.R. (2015). A Genetic Algorithms-Based LSSVM Classifier for Fixed-Size Set of Support Vectors. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2015. Lecture Notes in Computer Science(), vol 9095. Springer, Cham. https://doi.org/10.1007/978-3-319-19222-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-19222-2_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19221-5
Online ISBN: 978-3-319-19222-2
eBook Packages: Computer ScienceComputer Science (R0)