Decision Tree Twin Support Vector Machine Based on Kernel Clustering for Multi-class Classification

  • Qingyun Dou
  • Li ZhangEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11304)


To deal with multi-class classification problems using twin support vector machines (TWSVMs), this paper proposes a novel multi-class classifier, decision tree twin support vector machine based on kernel clustering (DT2SVM-KC). We employ the kernel clustering algorithm to generate a binary tree, and for each non-leaf node, we obtain a pair of non-parallel hyperplanes by using TWSVM. Simulation results show that the proposed method can keep the strength of decision tree in computation time and has better performance on most used datasets compared with other multi-class classification methods based on TWSVMs.


Twin support vector machine Decision tree Multi-class classification Kernel function 



We thanks to all those who contribute to the data sets of UCI machine learning repository that are used in this paper. This work was supported in part by the National Natural Science Foundation of China under Grant Nos. 61373093, 61402310, 61672364 and 61672365, by the Soochow Scholar Project of Soochow University, by the Six Talent Peak Project of Jiangsu Province of China, and by the Graduate Innovation and Practice Program of colleges and universities in Jiangsu Province.


  1. 1.
    Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 10(3), 273–297 (1995)zbMATHGoogle Scholar
  2. 2.
    Khemchandani, R.J., Chandra, S., et al: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–910 (2007)CrossRefGoogle Scholar
  3. 3.
    Tomar, D., Agarwal, S.: Twin support vector machine: a review from 2007 to 2014. Egypt. Inf. J. 16(1), 55–69 (2015)CrossRefGoogle Scholar
  4. 4.
    Shao, Y., Zhang, C., Wang, X., et al.: Improvements on twin support vector machines. IEEE Trans. Neural Networks 22(6), 962–968 (2011)CrossRefGoogle Scholar
  5. 5.
    Kumar, M.A., Gopal, M.: Least squares twin support vector machines for pattern classification. Expert Syst. Appl. 36(4), 7535–7543 (2009)CrossRefGoogle Scholar
  6. 6.
    Sartakhti, J.S., Ghadiri, N., Afrabandpey, H., et al: Fuzzy least squares twin support vector machines. Artificial Intelligence (2015)Google Scholar
  7. 7.
    Ding, S., Huang, H., Xu, X., et al.: Polynomial smooth twin support vector machines. Appl. Math. Inf. Sci. 8(4), 2063–2071 (2014)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Xu, Y., Yang, Z., Pan, X., et al.: A novel twin support-vector machine with pinball loss. IEEE Trans. Neural Networks 28(2), 359–370 (2017)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Xu, Y., Guo, R., Wang, L.: A twin multi-class classification support vector machine. Cogn. Comput. 5(4), 580–588 (2013)CrossRefGoogle Scholar
  10. 10.
    Tomar, D., Agarwal, S.: An effective weighted multi-class least squares twin support vector machine for imbalanced data classification. Int. J. Comput. Intell. Syst. 8(4), 761–778 (2015)CrossRefGoogle Scholar
  11. 11.
    Xie, J., Hone, K.S., Xie, W., et al.: Extending twin support vector machine classifier for multi-category classification problems. Intell. Data Analysis 17(4), 649–664 (2013)CrossRefGoogle Scholar
  12. 12.
    Yang, Z.X., Shao, Y.H., Zhang, X.S.: Multiple birth support vector machine for multi-class classification. Neural Comput. Appl. 22(1), 153–161 (2013)CrossRefGoogle Scholar
  13. 13.
    Zhen, W., Jin, C., Ming, Q.: Non-parallel planes support vector machine for multi-class classification. In: International Conference on Logistics Systems and Intelligent Management, pp. 581–585. IEEE, Harbin (2010)Google Scholar
  14. 14.
    Shao, Y.H., Chen, W.J., Huang, W.B., et al.: The best separating decision tree twin support vector machine for multi-class classification. Procedia Comput. Sci. 17, 1032–1038 (2013)CrossRefGoogle Scholar
  15. 15.
    Li, Z., Da, Z.W., Cheng, J.L., et al.: Kernel clustering algorithm. Chin. J. Comput. 25(6), 587–590 (2002)MathSciNetGoogle Scholar
  16. 16.
    Zhang, L., Zhou, W., Su, T.T., et al.: Decision tree support vector machine. Int. J. Artif. Intell. Tools 16(01), 1–16 (2007)CrossRefGoogle Scholar
  17. 17.
    Zhang, L., Zhou, W., Chang, P., et al.: Kernel sparse representation-based classifier. IEEE Trans. Signal Process. 60, 1684–1695 (2012)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.School of Computer Science and Technology and Joint International Research Laboratory of Machine Learning and Neuromorphi ComputingSoochow UniversitySuzhouChina

Personalised recommendations