Abstract
The tree architecture has been employed to solve multi-class problems based on SVM. It is an alternative to the well known OVO/OVA strategies. Most of the tree base SVM classifiers try to split the multi-class space, mostly, by some clustering like algorithms into several binary partitions. One of the main drawbacks of this is that the natural class structure is not taken into account. Also the same SVM parameterization is used for all classifiers. Here a preliminary and promising result of a multi-class space partition method that account for data base class structure and allow node‘s parameter specific solutions is presented. In each node the space is split into two class problem possibilities and the best SVM solution found. Preliminary results show that accuracy is improved, lesser information is required, each node reaches specific cost values and hard separable classes can easily be identified.
Chapter PDF
Similar content being viewed by others
References
Rifkin, R., Klautau, A.: Defence of OneVs.-All Classification. Journal of Machine Learning 5, 101–141 (2004)
Platt, C.N., Shawe-Taylor, J.: Large margin DAGSVMs for multiclass classification. In: Advances in Neural Information Processing System, vol. 12, pp. 547–553 (2000)
Fei, B., Liu, J.: Binary Tree of SVM: A New fast Multiclass Training and Classification algorithm. IEEE Trans. on Neural Networks 17, 3 (2006)
Madzarov, G., Gjorgjevikj, D., Chorbev, I.: A multi-class SVM Classifier Utilizing Binary Decision Tree. Informatica 33, 233–241 (2009)
Liu, X.P., Xing, H., Wang, X.: A multistage support vector machine. In: Proc. 2nd Conf. on Mach. Learning and Cybernetics, Xi’an (2003)
Ben-Hur, A., Horn, D.: Support vector Clustering. The Journal of Machine Learning Research Archive 2(3/1) (2002)
Cristianini, N., Shawe-Taylor, J.: An introduction to Support Vector Machines and other kernel-based learning methods. Cambridge Univ. Press (2000)
Gjorgji, M., Dejan, G., Ivan, C.: A Multiclass SVM Classifier Utilizing Binary Decision Tree. Informatica 33, 233–241 (2009)
Hastie, T.: http://www-stat.stanford.edu/~hastie/Papers/svmpath.pdf
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2, 27:1–27:27 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Arab Cohen, D., Fernández, E.A. (2012). SVMTOCP: A Binary Tree Base SVM Approach through Optimal Multi-class Binarization. In: Alvarez, L., Mejail, M., Gomez, L., Jacobo, J. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2012. Lecture Notes in Computer Science, vol 7441. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33275-3_58
Download citation
DOI: https://doi.org/10.1007/978-3-642-33275-3_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33274-6
Online ISBN: 978-3-642-33275-3
eBook Packages: Computer ScienceComputer Science (R0)