Survey on SVM and their application in image classification

Original Research
  • 8 Downloads

Abstract

Life of any living being is impossible if it does not have the ability to differentiate between various things, objects, smell, taste, colors, etc. Human being is a good ability to classify the object easily such as different human face, images. This is time of the machine so we want that machine can do all the work like as a human, this is part of machine learning. Here this paper discusses the some important technique for the image classification. What are the techniques through which a machine can learn for the image classification task as well as perform the classification task with efficiently. The most known technique to learn a machine is SVM. Support Vector machine (SVM) has evolved as an efficient paradigm for classification. SVM has a strongest mathematical model for classification and regression. This powerful mathematical foundation gives a new direction for further research in the vast field of classification and regression. Over the past few decades, various improvements to SVM has appeared, such as twin SVM, Lagrangian SVM, Quantum Support vector machine, least square support vector machine, etc., which will be further discussed in the paper, led to the creation of a new approach for better classification accuracy. For improving the accuracy as well as performance of SVM, we must aware of how a kernel function should be selected and what are the different approaches for parameter selection. This paper reviews the different computational model of SVM and key process for the SVM system development. Furthermore provides survey on their applications for image classification.

Keywords

Support vector machine (SVM) Image classification Kernel function Machine learning Color image Decision space 

References

  1. 1.
    Cortes C, and Vapnik V (1995) Support-vector network. Mach Learn 20(3):273–297Google Scholar
  2. 2.
    Tomar D, Agarwal S (2015) A comparison on multi-class classification methods based on least squares twin support vector machine. Knowl-Based Syst 81:131–147CrossRefGoogle Scholar
  3. 3.
    Mangasarian OL, Musicant DR (2001) Lagrangian support vector machines. J Mach Learn Res 1:161–177MathSciNetMATHGoogle Scholar
  4. 4.
    Xiang Z, XueqiangLv, Zhang K (2014) An Image Classification Method Based On Multi-feature Fusion and Multi-kernel SVM. In: Seventh International Symposium on Computational Intelligence and Design, Hangzhou, p 49–52Google Scholar
  5. 5.
    Hsu C-W, Lin C-J (2012) A comparison of methods for multi-class support vector machines. IEEE Trans Neural Networks 13(2):415–425Google Scholar
  6. 6.
    Milgram J, Cheriet M, Sabourin R (2006) One Against One or One Against All: Which One is Better for Handwriting Recognition with SVMs. In: Tenth International Workshop on Frontiers in Handwriting Recognition, Oct 2006, La Baule (France), Suvisoft,Google Scholar
  7. 7.
    Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vectormachine for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRefMATHGoogle Scholar
  8. 8.
    Han J, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann Publishers, USAGoogle Scholar
  9. 9.
    Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46:389–422CrossRefMATHGoogle Scholar
  10. 10.
    Prajapati GL,and Patle A(2010) On Performing Classification Using SVM with Radial Basis and Polynomial Kernel Functions. In: Third International Conference on Emerging Trends in Engineering and Technology, p 512–515Google Scholar
  11. 11.
    Kuo B-C, Ho H-H, Li C-H, Hung C-C, Taur J-S (2014) A kernel-based feature selection method for SVM with RBF kernel for hyperspectral image classification. IEEE J sel Topic Appl Earth Observ Remote Sens 7(1):317–326CrossRefGoogle Scholar
  12. 12.
    Morariu D, Vintan LN, Volker Tresp V (2006) Feature selection methods for an improved SVM classifier. Trans Eng 14:83–89Google Scholar
  13. 13.
    Huang C, Chen M, Wang C (2007) Credit scoring with a data mining approach based on SVMs. National Kaohsiung First university of Science and Technology, Department of Information Management, Nantz District, pp 847–856Google Scholar
  14. 14.
    Lin W, Lee Z, Lee S (2008) Parameter determination of support vector machine and feature selection using simulated annealing approach. Applied Soft Comput 8:1505–1512CrossRefGoogle Scholar
  15. 15.
    Wang Z, Zhu C, Niu Z, Gao D, Feng X (2014) Multi-kernel classification machine with reduced complexity. Knowl-Based Syst 65:83–95CrossRefGoogle Scholar
  16. 16.
    Scholkopf B, Burges CJC, Smola AJ (1999) Advances in kernel methods: support vector learning. MIT Press, CambridgeMATHGoogle Scholar
  17. 17.
    Du P, Tan K, Xing X (2010) Wavelet SVM in reproducing kernel hilbert space for hyper-spectral remote sensing image classification. Opt Commun 283(24):4978–4984CrossRefGoogle Scholar
  18. 18.
    Haar A (1910) Zurtheorie der orthogonalen funktionen systeme. Math Ann 69:331–371MathSciNetCrossRefGoogle Scholar
  19. 19.
    Graps A (1995) An Introduction to Wavelets. IEEE Comput Sci Eng 2(2):50–61CrossRefGoogle Scholar
  20. 20.
    Agarwal E, Gupta S, Chandra MA (2014) Data hiding using lazy wavelet transform strategy. IJCA Proceedings on International Conference on Advances in Computer Engineering and Applications. ICACEA 5:5–8Google Scholar
  21. 21.
    Wickerhauser MV (1992) Acoustic signal compression with wave packets: wavelets: a tutorial in theory and applications. Academic Press Professional, San Diego, pp 679–700Google Scholar
  22. 22.
    Myint SW, Zhu T, Zheng B (2015) A novel image classification algorithm using over complete wavelet transforms. IEEE Geosci Remote Sens Lett 12(6):1232–1236CrossRefGoogle Scholar
  23. 23.
    Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) Classification of healthcare data using genetic fuzzy logic system and wavelets. Expert Syst Appl 42:2184–2197CrossRefGoogle Scholar
  24. 24.
    Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) Medical data classification using interval type-2 fuzzy logic system and wavelets. Applied Soft Comput 30:812–822CrossRefGoogle Scholar
  25. 25.
    Tan Y, Li G, Duan H, Li C (2014) Enhancement of medical image details via wavelet homomorphic filtering transform. J Intell Syst 23(1):83–94Google Scholar
  26. 26.
    McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5:115–133MathSciNetCrossRefMATHGoogle Scholar
  27. 27.
    Rosenblatt F (1957) The perceptron—a perceiving and recognizing automaton. Cornell aeronautical laboratory, report number: 85-460-1Google Scholar
  28. 28.
    Kohonen T (1982) Self-organized formation of topologically correct feature maps. Biol Cybern 43:59–69MathSciNetCrossRefMATHGoogle Scholar
  29. 29.
    Broomhead D S, lowe D (1988) Radial basis functions, multi-variable functional interpolation and adaptive networks, royal signals and radar establishment memorandum No. 4148, 38Google Scholar
  30. 30.
    Widrow B, Hoff ME (1960) Adaptive switching circuits. IRE WESCON Conven Rec 4:96–104Google Scholar
  31. 31.
    Rumelhart DE, McClelland JL (eds) (1986) Parallel distributed processing: explorations in the microstructure of cognition, vol 1. MIT Press, CambridgeGoogle Scholar
  32. 32.
    Broomhead DS, Lowe D (1988) Multivariable function interpolation and adaptive networks. Complex Syst 2:321–355MATHGoogle Scholar
  33. 33.
    Weston J, Mukherjee S, Chapelle O, Pontil M, Poggio T, Vapnik V (2000) Feature Selection for SVMs. In: Proceeding NIPS’00 Proceedings of the 13th International Conference on Neural Information Processing Systems. p 647–653Google Scholar
  34. 34.
    Chapelle O, Vapnik V, Bousquet O, Mukhetjee S (2000) Choosing kernel parameters for support vector machines. Mach Learn 46(1–3):131–159MATHGoogle Scholar
  35. 35.
    Burbidge R, Buxton B (2001) An introduction to support vector machines for data mining. Computer Science Dept.,UCL, UKGoogle Scholar
  36. 36.
    Chi M, Feng R, Bruzzone L (2008) Classification of hyper-spectral remote-sensing data with primal SVM for small-sized training dataset problem. Adv Space Res 41:1793–1799CrossRefGoogle Scholar
  37. 37.
    Tao S, Chen D, Zhao W (2009) pruning algorithm for multi-output LS-SVM and its application in chemical pattern classification. Chemometr Intell Lab Syst 96:63–69CrossRefGoogle Scholar
  38. 38.
    Tanoori B, Azimifar Z, Shakibafar A, Katebi S (2011) Brain volumetry: an active contour model-based segmentation followed by SVM-based classification. Comput Biol Med 41:619–632CrossRefGoogle Scholar
  39. 39.
    Sugumaran V, Ramchandran KI (2011) Effect of number of features on classification of roller bearing faults using SVM and PSVM. Expert Syst Appl 38:4088–4096CrossRefGoogle Scholar
  40. 40.
    Liu Y-T, Zhang H-X, Li P-H (2011) Research on SVM-based MRI image segmentation. J China Univ Posts Telecommun 18(2):129–132CrossRefGoogle Scholar
  41. 41.
    YANG L, YANG F, NOGUCHI N (2011) Apple Internal Quality Classification Using X-ray and SVM. In: Proceedings of the 18th World Congress The International Federation of Automatic Control IFAC Proceedings, Volume 44, Issue 1, January 2011, p 14145–14150 Milano (Italy)Google Scholar
  42. 42.
    Wang Z, Sun X (2011) Document classification algorithm based on MMP and LS-SVM. Advanced in Control Engineering and Information Science. Procedia Eng 15:1565–1569CrossRefGoogle Scholar
  43. 43.
    Homaeinezhad MR, Tavakkoli E, Atyabi SA, Ghaffari A, Ebrahimpour R (2011) Synthesis of multiple-type classification algorithms for robust heart rhythm type recognition: neuro-svm-pnn learning machine with virtual QRS image-based geometrical features. Scientia Iranica B 18(3):423–431Google Scholar
  44. 44.
    Lo C-S, Wang C-M (2012) Support vector machine for breast MR image classification. Comput Math Appl 64:1153–1162CrossRefMATHGoogle Scholar
  45. 45.
    Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCs in mammogram imaging. Knowl-Based Syst 26:144–153CrossRefGoogle Scholar
  46. 46.
    Yang Q, Liang J, Hub Z, Xing Z, Zhao H (2012) Automatic recognition of poleward moving auroras from all-sky image sequences based on HMM and SVM. Planet Space Sci 69(2012):40–48CrossRefGoogle Scholar
  47. 47.
    Xiang Z, Lv X, Zhang K (2014) An Image Classification method based on multi-feature fusion and multi-kernel SVM. In: 2014 seventh international symposium on computational intelligence and design, Hangzhou, p 49–52Google Scholar
  48. 48.
    Tang YY, Lu Y, Yuan H (2015) Hyper-spectral image classification based on three-dimensional scattering wavelet transform. IEEE Trans Geosci Remote Sens 53(5):2467–2480CrossRefGoogle Scholar
  49. 49.
    Kumar B, Dikshit O (2015) Spectral-Spatial Classification of Hyper-spectral Imagery Based on Moment Invariants. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8(6):2457–2463CrossRefGoogle Scholar
  50. 50.
    Goela S, Gaur M, Jain E (2015) Nature inspired algorithms in remote sensing image classification. Procedia Comput Sci 57:377–384CrossRefGoogle Scholar
  51. 51.
    Peng J, Zhou Y, Chen CLP (2015) Region-kernel-based support vector machines for hyper-spectral image classification. IEEE Trans Geosci Remote Sens 53(9):4810–4824CrossRefGoogle Scholar
  52. 52.
    Yang W, Yin X, Xia G-S (2015) Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans Geosci Remote Sens 53(8):4472–4482CrossRefGoogle Scholar
  53. 53.
    Wu Z, Liu J, Plaza A, Li J, Wei Z (2015) GPU implementation of composite kernels for hyper-spectral image classification. IEEE Geosci Remote Sens Lett 12(9):1973–1977CrossRefGoogle Scholar
  54. 54.
    Song Y, Cai W, Huang H, Zhou Y, Feng DD, Wang Y, Fulham MJ, Chen M (2015) large margin local estimate with applications to medical image classification. IEEE Trans Med Imaging 34(6):1362–1377CrossRefGoogle Scholar
  55. 55.
    Luo Y, Liu T, Tao D, Xu C (2015) Multiview matrix completion for multilabelimage classification. IEEE Trans Image Process 24(8):2355–2368MathSciNetCrossRefGoogle Scholar
  56. 56.
    Yin H, Jiao X, Chai Y, Fang B (2015) Scene classification based on single-layer SAE and SVM. Expert Syst Appl 42:3368–3380CrossRefGoogle Scholar
  57. 57.
    Sugamya K, Pabboju S, Babu S V (2016) A CBIR Classification Using Support Vector Machines. In: International Conference on Advances in Human Machine Interaction (HMI—2016)Google Scholar
  58. 58.
    Liu S, Chen X, Fan D, Chen X, Meng F, Huang Q (2016) 3D Smiling Facial Expression Recognition Based on SVM. In: 2016 IEEE International Conference on Mechatronics and Automation, Harbin, p 1661–1666Google Scholar
  59. 59.
    Oliva J T, Lee HD, Spolaôr N, Coy CSR, Wu FC (2016) Prototype system for feature extraction, classification and study of medical images. Expert Syst Appl 63 No. C, 267–283Google Scholar
  60. 60.
    Wei Z, Hoai M (2016) Region Ranking SVM for Image Classification. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, p 2987–2996Google Scholar
  61. 61.
    Ding J, Cao G, Meng D (2016) Classification of Tongue Images Based on Doublet SVM. In: International Symposium on System and Software Reliability (ISSSR), Shanghai, p 77–81Google Scholar
  62. 62.
    Sachdeva J, Kumar V, Gupta I, Khandelwal N, Ahuja CK (2016) A package-SFERCB-Segmentation, feature extraction, reduction and classification analysis by both SVM and ANN for brain tumors. Appl Soft Comput 47:151–167CrossRefGoogle Scholar
  63. 63.
    Garali I, Adel M, Bourennane S, Guedj E (2016) Classification of positron emission tomography brain images using first and second derivative features. In: 2016 6th European Workshop on Visual Information Processing (EUVIP), Marseille, pp. 1-5.EUVIP 201, p 1–5Google Scholar
  64. 64.
    Park S, Lee HS, Kim J (2017) Seed growing for interactive image segmentation using SVM classification with geodesic distance. Electron Lett 53(1):22–24CrossRefGoogle Scholar
  65. 65.
    Wang S, Liu Q, Zhu E, Porikli F, Yin J (2018) Hyperparameter selection of one-class support vector machine by self-adaptive data shifting. Pattern Recogn 74:198–211CrossRefGoogle Scholar
  66. 66.
    Mahesh VGV, Raj ANJ (2018) Zernike moments and machine learning based gender classification using facial images. In: Abraham A, Cherukuri A, Madureira A, Muda A (eds) Proceedings of the Eighth International Conference on Soft Computing and Pattern Recognition (SoCPaR 2016). SoCPaR 2016. Advances in Intelligent Systems and Computing, vol 614. Springer, ChamGoogle Scholar
  67. 67.
    Priya C A, Balasaravanan T, Thanamani A S (2012) An efficient leaf recognition algorithm for plant classification using support vector machine. In: International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME-2012), Salem, Tamilnadu, p 428–432Google Scholar
  68. 68.
    Es-saady Y, Massi I El, Yassa I El, Mammass, D, A. Benazoun A (2016) Automatic recognition of plant leaves diseases based on serial combination of two SVM classifiers. In: 2016 International Conference on Electrical and Information Technologies (ICEIT), Tangiers, p 561–566Google Scholar
  69. 69.
    Tomar D, Agarwal S (2016) Leaf recognition for plant classification using direct acyclic graph based multi-class least squares twin support vector machine. Int J Image Graph 16(3):1650012MathSciNetCrossRefGoogle Scholar
  70. 70.
    Lukic M, Tuba E, Tuba M (2017) Leaf recognition algorithm using support vector machine with Hu moments and local binary patterns. In: IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI), Herl’any p 000485–000490Google Scholar

Copyright information

© Bharati Vidyapeeth's Institute of Computer Applications and Management 2018

Authors and Affiliations

  1. 1.Department of CSITMJP Rohilkhand UniversityBareillyIndia

Personalised recommendations