A Fuzzy support vector classifier based on Bayesian optimization
- 102 Downloads
In this paper, we have focused on the use of the support vector data description based on kernel-based possibilistic c-means algorithm (PCM) for solving multi-class classification problems. We propose a weighted support vector data description (SVDD) multi-class classification method, which can be used to deal with the outlier sensitivity problem in traditional multi-class classification problems. The proposed method is the robust version of SVDD by assigning a weight to each data point, which represents fuzzy membership degree of the cluster computed by the kernel-based PCM method. Accordingly, this paper presents the multi classification algorithm and gives the simple classification rule, which satisfies Bayesian optimal decision theory. With a simple classification rule, our experimental results show that the proposed method can reduce the effect of outliers and reduce the rate of classification error.
KeywordsSupport vector machine Support vector data description Possibilistic c-means algorithm Kernel method Bayesian optimization
Unable to display preview. Download preview PDF.
- Inoue, T., & Abe, S. (2001). Fuzzy support vector machines for pattern classification. In Proceedings of International Joint Conference on Neural Networks Vol. 2. pp. 1449–1454.Google Scholar
- Lin, C. F., & Wang, S. D. (2003). Training algorithms for fuzzy support vector machines with noisy data. In: Proceedings of the IEEE 8th Workshop on Neural Networks for Signal Processing, pp. 517–526.Google Scholar
- Platt, J. C., Cristianini, N., & Shawe-Taylor, J. (2002). Large margin DAG’s for multiclass classification. In S. A. Solla, T. K. Leen, & K. R. Müller (Eds.), Advances in Neural Information Processing Systems (Vol. 12). pp. 547–553.Google Scholar
- Schölkopf, B., Burges, C., & Vapnik, V. N. (1995). Extracting support data for a given task. In Proceedings of First International Conference on Knowledge Discovery and Data Mining, pp. 252–257.Google Scholar
- Schölkopf B., Smola A.J. (2002). Learning with Kernels. Cambridge, MA, MIT PressGoogle Scholar
- Wang J., Neskovic P., Cooper L.N. (2007). Bayes classification based on minimum bounding spheres. Neurocomputing 70, 801–808Google Scholar
- Weston, J., & Watkins, C. (1998). Multi-class support vector machines. Department of Computer Science, Royal Holloway University of London Technical Report, SD2TR298204.Google Scholar
- Zhu, M. L., Chen, S. F., & Liu, X. D. (2003). Sphere-structured support vector machines for multi-class pattern recognition. In Lecture Notes in Computer Science (Vol. 2639). pp. 589–593.Google Scholar