Reducing Number of Classifiers in DAGSVM Based on Class Similarity
Support Vector Machines are excellent binary classifiers. In case of multi–class classification problems individual classifiers can be collected into a directed acyclic graph structure DAGSVM. Such structure implements One-Against-One strategy. In this strategy a split is created for each pair of classes, but, because of hierarchical structure, only a part of them is used in the single classification process.
The number of classifiers may be reduced if their classification tasks will be changed from separation of individual classes into separation of groups of classes. The proposed method is based on the similarity of classes. For near classes the structure of DAG stays immutable. For the distant classes more than one is separated with a single classifier. This solution reduces the classification cost. At the same time the recognition accuracy is not reduced in a significant way. Moreover, a number of SV, which influences on the learning time will not grow rapidly.
KeywordsClassification Directed Acyclic Graph Support Vector Machines One–Against–One
- 1.Abe, S.: Support Vector Machines for Pattern Classification (Advances in Pattern Recognition). Springer-Verlag New York, Inc., Secaucus (2005)Google Scholar
- 2.Kumar, M.A., Gopal, M.: A comparison study on multiple binary-class SVM methods for unilabel text categorization. Pattern Recogn. Lett. 32, 9160:311–9160:323 (2010), http://dx.doi.org/10.1007/s11063-010-9160-y
- 3.Bennett, K.P.: Combining support vector and mathematical programming methods for classification, pp. 307–326. MIT Press, Cambridge (1999)Google Scholar
- 4.Crammer, K., Singer, Y.: On the learnability and design of output codes for multiclass problems. In: COLT 2000: Proceedings of the Thirteenth Annual Conference on Computational Learning Theory, pp. 35–46. Morgan Kaufmann Publishers Inc., San Francisco (2000)Google Scholar
- 7.Kressel, U.H.G.: Pairwise classification and support vector machines, pp. 255–268. MIT Press, Cambridge (1999)Google Scholar
- 8.Platt, J., Cristianini, N., ShaweTaylor, J.: Large margin dags for multiclass classification. In: Solla, S.A., Leen, T.K., Mueller, K.-R. (eds.) Advances in Neural Information Processing Systems 12, pp. 547–553 (2000)Google Scholar
- 10.Stapor, K.: Geographic map image interpretation - survey and problems. Machine Graphics & Vision 9(1/2), 497–518 (2000)Google Scholar
- 12.Wilson, R.J.: Introduction to graph theory. John Wiley & Sons, Inc., New York (1986)Google Scholar