Enhancing Incremental Feature Subset Selection in High-Dimensional Databases by Adding a Backward Step
Feature subset selection has become an expensive process due to the relatively recent appearance of high-dimensional databases. Thus, the need has arisen not only for reducing the dimensionality of these datasets, but also for doing it in an efficient way. We propose the design of a new backward search which performs better than other state-of-the-art algorithms in terms of size of the selected subsets and in the number of evaluations, by removing attributes given a smart decremental approach and, besides, it is guided using a heuristic which reduces the needed number of evaluations commonly expected from a backward search.
This work has been partially supported by the JCCM under project PCI08-0048-8577 and CICYT under project TIN2010-20900-C04-03.
- 1.Bermejo, P., Gámez, J., Puerta, J.: On incremental wrapper-based attribute selection: experimental analysis of the relevance criteria. In: IPMU’08: Proceedings of the 12th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, Málaga (2008)Google Scholar
- 2.Bermejo, P., Gámez, J.A., Puerta, J.M.: Incremental wrapper-based subset selection with replacement: an advantageous alternative to sequential forward selection. In: Proceedings of the IEEE Symposium on Computational Intelligence and Data Mining (CIDM-2009), Málaga (2009)Google Scholar