Enhanced Iterative Projection for Subclass Analysis under EM Framework
Linear discriminant analysis (LDA) is a very popular supervised classification approach. But it cannot perform well in some cases such as large sample size, etc. In terms of its shortcoming, some scholars in this area put up the idea of subclass, which can break out of LDA’s limitation and achieve better classification results. Subclass discriminant analysis (SDA) worked out the division of subclasses, before solving the generalized eigenvalue problem. By contrast, our proposed approach performs subclass division based on K-means cluster, class by class, in the iterative steps under EM framework. The experimental results on two character databases show that our proposed approach can achieve better results than SDA, meanwhile not quite time-consuming.
KeywordsLinear discriminant analysis larger sample size subclass discriminant analysis EM framework iteration generalized eigenvalue problem K-means cluster
Unable to display preview. Download preview PDF.
- 2.Fisher, R.A.: The use of multiple measurements in taxonomic problem. J. Annals Eugenics 7(2), 179–188 (1936)Google Scholar
- 3.Welling, M.: Fisher Linear Discriminant Analysis, http://www.ics.uci.edu/~welling/classnotes/papers_class/Fisher-LDA.pdf
- 4.Sun, L., Ceran, B., Ye, J.: A Scalable Two-Stage Approach for a Class of Dimensionality Reduction Techniques. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2010, pp. 313–322 (2010)Google Scholar
- 6.Boyd, S., Vandenberghe, L.: Convex optimization. Cambridge University Press (2004)Google Scholar
- 7.Sun, L., Ji, S., Ye, J.: Hypergraph Spectral Learning for Multi-label Classification. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2008, pp. 668–676 (2008)Google Scholar
- 8.Wang, X., Tang, X.: Dual-Space Linear Discriminant Analysis for Face Recognition. In: Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. 564–569 (2004)Google Scholar