Linear Classification of Data with Support Vector Machines and Generalized Support Vector Machines

  • Talat NazirEmail author
  • Xiaomin Qi
  • Sergei Silvestrov
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 179)


In this paper, we study the support vector machine and introduced the notion of generalized support vector machine for classification of data. We show that the problem of generalized support vector machine is equivalent to the problem of generalized variational inequality and establish various results for the existence of solutions. Moreover, we provide various examples to support our results.


Linear classification Support vector machine Generalized support vector machine Kernel function 



Talat Nazir and Xiaomin Qi are grateful to the Erasmus Mundus project FUSION for supporting the research visit to Mälardalen University, Sweden, and to the Research environment MAM in Mathematics and Applied Mathematics, Division of Applied Mathematics, the School of Education, Culture and Communication of Mälardalen University for creating excellent research environment.


  1. 1.
    Adankon, M.M., Cheriet, M.: Model selection for the LS-SVM. Application to handwriting recognition. Pattern Recognit. 42(12), 3264–3270 (2009)CrossRefzbMATHGoogle Scholar
  2. 2.
    Cortes, C., Vapnik, V.N.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  3. 3.
    Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and other Kernel Based Learning Methods. Cambridge University Press, Cambridge (2000)CrossRefzbMATHGoogle Scholar
  4. 4.
    Guyon, I., Weston, J., Barnhill, S., Vapnik, V.: Gene selection for cancer classification using support vector machines. Mach. Learn. 46(1–3), 389–422 (2002)CrossRefzbMATHGoogle Scholar
  5. 5.
    Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Proceedings of the European Conference on Machine Learning. Springer (1998)Google Scholar
  6. 6.
    Khan, N., Ksantini, R., Ahmad, I., Boufama, B.: A novel SVM+NDA model for classification with an application to face recognition. Pattern Recognit. 45(1), 66–79 (2012)CrossRefzbMATHGoogle Scholar
  7. 7.
    Li, S., Kwok, J.T., Zhu, H., Wang, Y.: Texture classification using the support vector machines. Pattern Recognit. 36(12), 2883–2893 (2003)CrossRefzbMATHGoogle Scholar
  8. 8.
    Liu, R., Wang, Y., Baba, T., Masumoto, D., Nagata, S.: SVM-based active feedback in image retrieval using clustering and unlabeled data. Pattern Recognit. 41(8), 2645–2655 (2008)CrossRefzbMATHGoogle Scholar
  9. 9.
    Michel, P., Kaliouby, R. E.: Real time facial expresion recognition in video using support vector machines. In: Proceedings of ICMI 2003, pp. 258–264 (2003)Google Scholar
  10. 10.
    Noble, W.S.: Support Vector Machine Applications in Computational Biology. MIT Press, Cambridge (2004)Google Scholar
  11. 11.
    Shao, Y., Lunetta, R.S.: Comparison of support vector machine, neural network, and CART algorithms for the land-cover classification using limited training data points. ISPRS J. Photogramm. Remote Sens. 70, 78–87 (2012)CrossRefGoogle Scholar
  12. 12.
    Shao, Y.H., Chen, W.J., Deng, N.Y.: Nonparallel hyperplane support vector machine for binary classification problems. Inf. Sci. 263, 22–35 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (1996)zbMATHGoogle Scholar
  14. 14.
    Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)zbMATHGoogle Scholar
  15. 15.
    Wang, X.Y., Wang, T., Bu, J.: Color image segmentation using pixel wise support vector machine classification. Pattern Recognit. 44(4), 777–787 (2011)CrossRefzbMATHGoogle Scholar
  16. 16.
    Wang, D., Qi, X., Wen, S., Deng., M.: SVM based fault classifier design for a water level control system. In: Proceedings of 2013 International Conference on Advanced Mechatronic Systems, Luoyang, China, pp. 152–157 (2013)Google Scholar
  17. 17.
    Wang, D., Qi, X., Wen, S., Dan, Y., Ouyang, L., Deng, M.: Robust nonlinear control and SVM classifier based fault diagnosis for a water level process. ICIC Express Lett. 5(1), 767–774 (2014)Google Scholar
  18. 18.
    Weston, J., Watkins, C.: Multi-class Support Vector Machines. Technical report CSD-TR- 98-04, Department of Computer Science, Royal Holloway, University of London (1998)Google Scholar
  19. 19.
    Wu, Y.C., Lee, Y.-S., Yang, J.-C.: Robust and efficient multiclass SVM models for phrase pattern recognition. Pattern Recognit. 41(9), 2874–2889 (2008)CrossRefzbMATHGoogle Scholar
  20. 20.
    Xue, Z., Ming, D., Song, W., Wan, B., Jin, S.: Infrared gait recognition based on wavelet transform and support vector machine. Pattern Recognit. 43(8), 2904–2910 (2010)CrossRefzbMATHGoogle Scholar
  21. 21.
    Zhao, Z., Liu, J., Cox, J.: Safe and efficient screening for sparse support vector machine. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD, New York, NY, USA, vol. 14, pp. 542–551 (2014)Google Scholar
  22. 22.
    Zuo, R., Carranza, E.J.M.: Support vector machine: a tool for mapping mineral prospectivity. Comput. Geosci. 37(12), 1967–1975 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Division of Applied Mathematics, School of Education, Culture and CommunicationMälardalen UniversityVästeråsSweden
  2. 2.Department of MathematicsCOMSATS Institute of Information TechnologyAbbottabadPakistan

Personalised recommendations