Abstract
In this paper, a novel hybrid Taguchi-Grey-based method for feature subset selection is proposed. The two-level orthogonal array is employed in the proposed method to provide a well-organized and balanced comparison of two levels of each feature (i.e., the feature is selected for pattern classification or not) and interactions among all features in a specific classification problem. That is, this two-dimensional matrix is mainly used to reduce the feature subset evaluation efforts prior to the classification procedure. Accordingly, the grey-based nearest neighbor rule and the signal-to-noise ratio (SNR) are used to evaluate and optimize the features of the specific classification problem. In this manner, important and relevant features can be identified for pattern classification. Experiments performed on different application domains are reported to demonstrate the performance of the proposed hybrid Taguchi-Grey-based method. It can be easily seen that the proposed method yields superior performance and is helpful for improving the classification accuracy in pattern classification.
Chapter PDF
Similar content being viewed by others
Keywords
References
Aha, D.W., Kibler, D., Albert, M.K.: Instance-based Learning Algorithms. Machine Learning 6, 37–66 (1991)
Bishop, C.M.: Neural Networks for Pattern Recognition, Oxford (1995)
Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases Irvine, CA: University of California, Department of Information and Computer Science (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Brassard, G., Bratley, P.: Fundamentals of Algorithms. Prentice Hall, New Jersey (1996)
Cawley, G.C., Talbot, N.L.C.: Efficient Leave-one-out Cross-validation of Kernel Fisher Discriminant Classifiers. Pattern Recognition 36(11), 2585–2592 (2003)
Cover, T.M., Hart, P.E.: Nearest Neighbor Pattern Classification. IEEE Trans. on Information Theory 13(1), 21–27 (1967)
Dasarathy, B.V.: Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. IEEE Computer Society Press, Los Alamitos, California (1990)
Deng, J.: The Theory and Method of Socioeconomic Grey Systems. Social Sciences in China 6, 47–60 (1984)
Deng, J.: Introduction to Grey System Theory. The Journal of Grey System 1, 1–24 (1989)
Deng, J.: Grey Information Space. The Journal of Grey System 1, 103–117 (1989)
Doak, J.: An Evaluation of Feature Selection Methods and Their Application to Computer Security. Technical Report, Univ. of California at Davis, Dept. Computer Science (1992)
Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. John Wiley & Sons, Chichester (1973)
Hall, M.A.: Correlation-based Feature Subset Selection for Machine Learning. PhD Dissertation, University of Waikato (1998)
Huang, C.C., Lee, H.M.: An Instance-based Learning Approach based on Grey Relational Structure. Applied Intelligence 25, 243–251 (2006)
Inza, I., Larrañaga, P., Sierra, B.: Feature Subset Selection by Bayesian Networks: a Comparison with Genetic and Sequential Algorithms. International Journal of Approximate Reasoning 27, 143–164 (2001)
Kohavi, R., John, G.H.: Wrappers for Feature Subset Selection. Artificial Intelligence 97(1-2), 273–324 (1997)
Liu, H., Motoda, H.: Feature Selection for Knowledge Discovery and Data Mining. Kluwer Academic, Boston (1998)
Liu, H., Setiono, R.: A Probabilistic Approach to Feature Selection - A Filter Solution. In: Proceedings of 13th International Conference on Machine Learning, pp. 319–327 (1996)
Liu, H., Yu, L.: Toward Integrating Feature Selection Algorithms for Classification and Clustering. IEEE Trans. Knowl. Data Eng. 17(4), 491–502 (2005)
Quinlan, J.R.: Induction of Decision Trees. Machine Learning 1, 81–106 (1986)
Stone, M.: Cross-validatory Choice and Assessment of Statistical Predictions. Journal of the Royal Statistical Society B 36, 111–147 (1974)
Taguchi, G.: Introduction to Quality Engineering. Tokyo: Asian Productivity Organization (1986)
Wu, Y., Wu, A., Taguchi, G.: Taguchi Methods for Robust Design. New York: ASME, pp. 7–10 (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chang, HY., Sun, CS. (2007). A Novel Hybrid Taguchi-Grey-Based Method for Feature Subset Selection. In: Rueda, L., Mery, D., Kittler, J. (eds) Progress in Pattern Recognition, Image Analysis and Applications. CIARP 2007. Lecture Notes in Computer Science, vol 4756. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76725-1_48
Download citation
DOI: https://doi.org/10.1007/978-3-540-76725-1_48
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76724-4
Online ISBN: 978-3-540-76725-1
eBook Packages: Computer ScienceComputer Science (R0)