Adaptive Genetic Algorithm to Select Training Data for Support Vector Machines
This paper presents a new adaptive genetic algorithm (AGA) to select training data for support vector machines (SVMs). SVM training data selection strongly influences the classification accuracy and time, especially in the case of large and noisy data sets. In the proposed AGA, a population of solutions evolves with time. The AGA parameters, including the chromosome length, are adapted according to the current state of exploring the solution space. We propose a new multi-parent crossover operator for an efficient search. A new metric of distance between individuals is introduced and applied in the AGA. It is based on the fast analysis of the vectors distribution in the feature space obtained using principal component analysis. An extensive experimental study performed on the well-known benchmark sets along with the real-world and artificial data sets, confirms that the AGA outperforms a standard GA in terms of the convergence capabilities. Also, it reduces the number of support vectors and allows for faster SVM classification.
KeywordsAdaptive genetic algorithm Support vector machines Training data selection
Unable to display preview. Download preview PDF.
- 3.Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines. ACM Trans. on Intell. Systems and Technology 2, 27:1–27:27 (2011)Google Scholar
- 5.Corne, D., Dorigo, M., Glover, F., Dasgupta, D., Moscato, P., Poli, R., Price, K.V.: New ideas in optimization, pp. 219–234. McGraw-Hill Ltd. (1999)Google Scholar
- 7.Elamin, E.E.A.: A proposed genetic algorithm selection method. In: 1st National Symposium (NITS), pp. 1–8 (2006)Google Scholar
- 8.Kawulok, M., Nalepa, J.: Support vector machines training data selection using a genetic algorithm. In: Hancock, E. Imiya, A., Kuijper, A. Kudo, M., Omachi, S., Windeatt, T., Yamada, K.: (eds.): SSPR & SPR 2012, LNCS 7626, pp. 557-565. Springer, Heidelberg (2012)Google Scholar
- 9.Koggalage, R., Halgamuge, S.: Reducing the number of training samples for fast support vector machine classification. Neural Inf. Process. Lett. and Reviews 2(3), 57–65 (2004)Google Scholar
- 12.Phung, S.L., Chai, D., Bouzerdoum, A.: Adaptive skin segmentation in color images. In: IEEE Int. Conf. on Acoustics, Speech and Signal Proc., pp. 353–356 (2003)Google Scholar
- 13.Schohn, G., Cohn, D.: Less is more: Active learning with support vector machines. In: 17th Int. Conf. on Mach. Learn., pp. 839–846. Morgan Kaufmann Inc. (2000)Google Scholar
- 18.Zeng, Z.Q., Xu, H.R., Xie, Y.Q., Gao, J.: A geometric approach to train SVM on very large data sets. Intell. Sys. and Knowl. Eng. 1, 991–996 (2008)Google Scholar
- 19.Zhang, W., King, I.: Locating support vectors via \(\beta \)-skeleton technique. In: Int. Conf. on Neural Inf. Process., 1423–1427 (2002)Google Scholar