Abstract
Feature selection has recently been the subject of intensive research in data mining, especially for datasets with a large number of attributes. Recent work has shown that feature selection can have a positive affect on the performance of machine learning algorithms. The success of many learning algorithms in their attempts to construct models of data, hinges on the reliable identification of a small set of highly predictive attributes. The inclusion of irrelevant, redundant and noisy attributes in the model building process phase can result in poor predictive performance and increased computation. In this paper, a novel feature search procedure that utilizes combining of the Ant Colony Optimization (ACO) and genetic algorithm (GA) is presented. The ACO is a meta-heuristic inspired by the behavior of real ants in their search for the shortest paths to food sources. It looks for optimal solutions by considering both local heuristics and previous knowledge. Genetic algorithm selects the best parameters for ant colony optimization in each step. When this algorithm applied to two different classification problems, the proposed algorithm achieved very promising results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hall, M.A.: Correlation-based Feature selection for Machine Learning, Ph.D. Thesis, Department of Computer Science. Hamilton. The University of Waikato, New Zeland (1999)
Kohavi, R., John, G.H.: The Wrapper Approach. In: Liu, H., Motoda, H. (eds.) Feature Selection for Knowledge Discovery and Data Mining, pp. 33–50. Kluwer Academic Publishers, Dordrecht (1998)
Dash, M., Liu, H.: Consistency-based search in feature selection. Artificial Intelligence 151, 155–176 (2003)
Deng, K., Moore, A.: On the Greediness of Feature Selection Algorithms. In: Van den Herik, H.J., Weijters, T. (eds.) International Conference of Machine Learning (ICML 1998), University Maastricht, The Netherlands (1998)
Skalak, D.: Prototype and Feature Selection by Sampling and Random Mutation Hill Climbing Algorithms. In: Eleventh International MachineLearning Conference, pp. 293–301. Morgan Kaufmann, New Brunswick (1994)
Klitter, J.: Feature set search algorithms. In: Chen, C.H. (ed.) Pattern Recognition and signal Processing, Sijhoff and Noordhoff, the Netherlands (1978)
Paudil, P., Novovicova, J., Klittler, J.: Floating search methods in feature selection. Pattern Recognition Letters 15, 1119–1125 (1994)
Narendra, P.M., Fukunaga, K.: A branch and bound algorithm for feature subset selection. IEEE Transaction on Computers C-26, 917–922 (1977)
Yang, J., Honavar, V.: Feature subset selection using a genetic algorithm. IEEE Transactions on Intelligent Systems 13, 44–49 (1998)
Sadeghzadeh, M., Shenasa, M.H.: Correlation Based Feature Selection Using Genetic Algorithms. In: Proceedings of the Third International Conference on Modeling, Simulation and Applied Optimization, Sharjah, U.A.E. (2009)
Sadeghzadeh, M., Shenasa, M.H.: Correlation Based Feature Selection Using Evolutionary Programming. In: Proceedings of the Twelfth IASTED International Conference on Artificial Intelligence and Soft Computing, Palma de Mallorca, Spain, pp. 185–190 (2008)
Holland, J.H.: Adaption in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)
Dorigo, M., Maniezzo, V., Colorni, A.: Ant Systems: Optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics-Part B 26, 29–41 (1996)
Blake, C., Keogh, E., Merz, C.J.: UCI Repository of Machine Learning Data Bases, University of California, Department of Information and Computer Science, Irvine, CA (1998), http://www.ics.uci.edu/~mlean/MLRepository.html (Accessed June 20, 2008)
Langky, P., Sage, S.: Scaling to domains with irrelevant features. In: Greiner, R. (ed.) Computational Learning Theory and Natural Learning Systems. MIT Press, Cambridge (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sadeghzadeh, M., Teshnehlab, M., Badie, K. (2010). Feature Selection Using Combine of Genetic Algorithm and Ant Colony Optimization. In: Gao, XZ., Gaspar-Cunha, A., Köppen, M., Schaefer, G., Wang, J. (eds) Soft Computing in Industrial Applications. Advances in Intelligent and Soft Computing, vol 75. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11282-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-11282-9_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-11281-2
Online ISBN: 978-3-642-11282-9
eBook Packages: EngineeringEngineering (R0)