Automatic Feature Selection by Genetic Algorithms
The efficient and automatic selection of features from an initial raw data set is an optimization task met in numerous applications fields, e.g., multivariate data classification, analysis, and visualization. The reduction of the variable number reduces the detrimental effects of the well-known curse of dimensionality. However, finding of the optimum solution in the selection process by exhaustive search is infeasible, as the underlying optimization problem is NP-complete. Thus, search heuristics are commonly applied to find acceptable solutions with a feasible computational effort. In this work, genetic algorithms are applied, based on dedicated nonparametric cost functions and multiobjective optimization. The method was implemented in our general QuickCog environment. For practical applications, competitive results were achieved.
KeywordsPareto Optimal Front Initial Array Automatic Feature Selection Underlying Optimization Problem Genetic String
Unable to display preview. Download preview PDF.
- K. Fukunaga, Introduction to Statistical Pattern Recognition. ACADEMIC PRESS, INC. Harcourt Brace Jovanovich, Publishers Boston San Diego New York London Sydney Tokyo Toronto, 1990.Google Scholar
- J. Kittler, Feature Selection and Extraction. ACADEMIC PRESS, INC. Tzai. Y. Young King SunFu, Publishers Orlando San Diego New York Austin London Montreal Sydney Tokyo Toronto, 1986.Google Scholar
- A. König, “Dimensionality Reduction Techniques for Multivariate Data Classification, Interactive Visualization, and Analysis — Systematic Feature Selection vs. Extraction,” in Proc. of 4th Int. Conf. on Knowledge-Based Intelligent Engineering Systems & Allied Technologies KES’2000, (University of Brighton, UK), pp. 44–56, August 2000.Google Scholar
- E. Zitzler and L. Thiele, “Multiobjective evolutionary algorithms: A comparative case study and the strength pareto approach,“ IEEE Transactions on Evolutionary Computation, vol. 3, pp. 257-271, Nov. 1999.Google Scholar
- A. König, A. Günther, A. Kröhnert, T. Grohmann, J. Düge, and M. Eberhardt, “Holistic Modelling and Parsimonious Design of Low-Power Integrated Vision and Cognition Systems,” in Proc. of 6th Int. Conf. on Soft Computing and Information/ Intelligent Systems IIZUKA’2000, (Iizuka, Fukuoka, Japan), pp. 710–717, October 2000.Google Scholar
- A. König, “A Novel Supervised Dimensionality Reduction Technique by Feature Weighting for Improved Neural Network Classifier Learning and Generalization,” in Proc. of 6th Int. ConJ. on Soft Computing and Information/Intelligent Systems IIZUKA’2000, (Iizuka, Fukuoka, Japan), pp. 746–753, October 2000.Google Scholar
- A. König, M. Eberhardt, and R. Wenzel, “QuickCog — HomePage,” in http://www.iee.et.tudresden. de/ ∼koeniga/QuickCog.html, 2000.Google Scholar