Linear and Nonlinear Classifiers of Data with Support Vector Machines and Generalized Support Vector Machines

  • Talat NazirEmail author
  • Xiaomin Qi
  • Sergei Silvestrov
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 179)


The support vector machine for linear and nonlinear classification of data is studied. The notion of generalized support vector machine for data classifications is used. The problem of generalized support vector machine is shown to be equivalent to the problem of generalized variational inequality and various results for the existence of solutions are established. Moreover, examples supporting the results are provided.


Linear and nonlinear classification Support vector machine Generalized support vector machine Kernel function 



Talat Nazir and Xiaomin Qi are grateful to the Erasmus Mundus project FUSION for supporting the research visit to Mälardalen University, Sweden, and to the Research environment MAM in Mathematics and Applied Mathematics, Division of Applied Mathematics, the School of Education, Culture and Communication of Mälardalen University for creating excellent research environment.


  1. 1.
    Adankon, M.M., Cheriet, M.: Model selection for the LS-SVM. Application to handwriting recognition. Pattern Recognit. 42(12), 3264–3270 (2009)CrossRefzbMATHGoogle Scholar
  2. 2.
    Cortes, C., Vapnik, V.N.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  3. 3.
    Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and other Kernel Based Learning Methods. Cambridge University Press, Cambridge (2000)Google Scholar
  4. 4.
    Guyon, I., Weston, J., Barnhill, S., Vapnik, V.: Gene selection for cancer classification using support vector machines. Mach. Learn. 46(1–3), 389–422 (2002)CrossRefzbMATHGoogle Scholar
  5. 5.
    Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Proceedings of the European Conference on Machine Learning. Springer, Heidelberg (1998)Google Scholar
  6. 6.
    Khan, N., Ksantini, R., Ahmad, I., Boufama, B.: A novel SVM+NDA model for classification with an application to face recognition. Pattern Recognit. 45(1), 66–79 (2012)CrossRefzbMATHGoogle Scholar
  7. 7.
    Li, S., Kwok, J.T., Zhu, H., Wang, Y.: Texture classification using the support vector machines. Pattern Recognit. 36(12), 2883–2893 (2003)CrossRefzbMATHGoogle Scholar
  8. 8.
    Liu, R., Wang, Y., Baba, T., Masumoto, D., Nagata, S.: SVM-based active feedback in image retrieval using clustering and unlabeled data. Pattern Recognit. 41(8), 2645–2655 (2008)CrossRefzbMATHGoogle Scholar
  9. 9.
    Michel, P., Kaliouby, R.E.: Real time facial expresion recognition in video using support vector machines. In: Proceedings of ICMI’03, pp. 258–264 (2003)Google Scholar
  10. 10.
    Noble, W.S.: Support Vector Machine Applications in Computational Biology. MIT Press, Cambridge (2004)Google Scholar
  11. 11.
    Shao, Y., Lunetta, R.S.: Comparison of support vector machine, neural network, and CART algorithms for the land-cover classification using limited training data points. ISPRS J. Photogramm. Remote Sens. 70, 78–87 (2012)CrossRefGoogle Scholar
  12. 12.
    Shao, Y.H., Chen, W.J., Deng, N.Y.: Nonparallel hyperplane support vector machine for binary classification problems. Inf. Sci. 263, 22–35 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (1996)zbMATHGoogle Scholar
  14. 14.
    Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)zbMATHGoogle Scholar
  15. 15.
    Wang, D., Qi, X., Wen, S., Deng, M.: SVM based fault classifier design for a water level control system. In: Proceedings of 2013 International Conference on Advanced Mechatronic Systems, pp. 152–157. Luoyang, China (2013)Google Scholar
  16. 16.
    Wang, D., Qi, X., Wen, S., Dan, Y., Ouyang, L., Deng, M.: Robust nonlinear control and SVM classifier based fault diagnosis for a water level process. ICIC Express Lett. 5(1), 767–774 (2014)Google Scholar
  17. 17.
    Wang, X.Y., Wang, T., Bu, J.: Color image segmentation using pixel wise support vector machine classification. Pattern Recognit. 44(4), 777–787 (2011)CrossRefzbMATHGoogle Scholar
  18. 18.
    Weston, J., Watkins, C.: Multi-class support vector machines. Technical report CSD-TR- 98-04, Department of Computer Science, Royal Holloway, University of London (1998)Google Scholar
  19. 19.
    Wu, Y.C., Lee, Y.-S., Yang, J.-C.: Robust and efficient multiclass SVM models for phrase pattern recognition. Pattern Recognit. 41(9), 2874–2889 (2008)CrossRefzbMATHGoogle Scholar
  20. 20.
    Xue, Z., Ming, D., Song, W., Wan, B., Jin, S.: Infrared gait recognition based on wavelet transform and support vector machine. Pattern Recognit. 43(8), 2904–2910 (2010)CrossRefzbMATHGoogle Scholar
  21. 21.
    Zhao, Z., Liu, J., Cox, J.: Safe and efficient screening for sparse support vector machine. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 14, pp. 542–551, New York, NY, USA (2014)Google Scholar
  22. 22.
    Zuo, R., Carranza, E.J.M.: Support vector machine: a tool for mapping mineral prospectivity. Comput. Geosci. 37(12), 1967–1975 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Division of Applied MathematicsSchool of Education, Culture and Communication, Mälardalen UniversityVästeråsSweden
  2. 2.Department of MathematicsCOMSATS Institute of Information TechnologyAbbottabadPakistan

Personalised recommendations