Abstract
Support Vector Machine (SVM) is gaining much popularity as one of effective methods for machine learning in recent years. In pattern classification problems with two class sets, it generalizes linear classifiers into high dimensional feature spaces through nonlinear mappings defined implicitly by kernels in the Hilbert space so that it may produce nonlinear classifiers in the original data space. Linear classi- fiers then are optimized to give the maximal margin separation between the classes. This task is performed by solving some type of mathematical programming such as quadratic programming (QP) or linear programming (LP). On the other hand, from a viewpoint of mathematical programming for machine learning, the idea of maximal margin separation was employed in the multi-surface method (MSM) suggested by Mangasarian in 1960’s. Also, linear classifiers using goal programming were developed extensively in 1980’s. This chapter introduces a new family of SVM using multi-objective programming and goal programming (MOP/GP) techniques, and discusses its effectiveness throughout several numerical experiments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Asada, T. and Nakayama, H. (2003) SVM using Multi Objective Linear Programming and Goal Programming, in T. Tanino, T. Tanaka and M. Inuiguchi (eds.), Multi-objective Programming and Goal Programming, 93–98
Bennett, K.P. and Mangasarian, O.L. (1992) Robust Linear Programming Discrimination of Two Linearly Inseparable Sets, Optimization Methods and Software, 1, 23–34
Cavalier, T.M., Ignizio, J.P. and Soyster, A.L., (1989) Discriminant Analysis via Mathematical Programming: Certain Problems and their Causes, Computers and Operations Research, 16, 353–362
Chankong, V. and Haimes, Y.Y., (1983) Multiobjective Decision Making Theory and Methodlogy , Elsevier Science Publsihing
Charnes, A. and Cooper W.W., (1961) Management Models and Industrial Applications of Linear Programming , vol. 1, Wiley
Cortes, C. and Vapnik, V., (1995) Support Vector Networks, Machine Learning, 20, pp. 273–297
Cristianini, N. and Shawe-Taylor, J., (2000) An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, Cambridge University Press
Erenguc, S.S. and Koehler, G.J., (1990) Survey of Mathematical Programming Models and Experimental Results for Linear Discriminant Analysis, Managerial and Decision Economics, 11, 215–225
Freed, N. and Glover, F., (1981) Simple but Powerful Goal Programming Models for Discriminant Problems, European J. of Operational Research, 7, 44–60
Glover, F. (1990) Improved Linear Programming Models for Discriminant Analysis, Decision Sciences, 21, 771–785
Mangasarian, O.L., (1968) Multisurface Method of Pattern Separation, IEEE Transact. on Information Theory, IT-14, 801–807
Mangasarian, O.L., (1999) Arbitrary-Norm Separating Plane, Operations Research Letters 23
Marcotte, P. and Savard, G., (1992) Novel Approaches to the Discrimination Problem, ZOR–Methods and Models of Operations Research, 36, pp.517–545
Miettinen, K. M., (1999) Nonlinear Multiobjective Optimization, Kluwer Academic Publishers
Nakayama, H., (1995) Aspiration Level Approach to Interactive Multi-objective Programming and its Applications, Advances in Multicriteria Analysis, ed. by P.M. Pardalos, Y. Siskos and C. Zopounidis, Kluwer Academic Publishers, pp. 147–174
Nakayama, H. and Asada, T., (2001) Support Vector Machines formulated as Multi Objective Linear Programming, Proc. of ICOTA 2001, 3, pp.1171–1178
Novikoff, A.B., (1962) On the Convergence Proofs on Perceptrons, In Symposium on the Mathematical Theory of Automata, vol. 12, pp. 615–622, Polytechnic Institute of Brooklyn
Sawaragi, Y., Nakayama, H. and Tanino, T., (1994) Theory of Multiobjective Optimization, Academic Press
Schölkopf, B. and Smola, A.J., (1998) New Support Vector Algorithms, NeuroCOLT2 Technical report Series, NC2-TR-1998–031
B. Schölkopf, and A.J. Smola, (2002) Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond-, MIT Press
Steuer, R.E., (1986) Multiple Criteria Optimization: Theory, Computation, and Application, Wiley
Vapnik, V.N., (1998) Statistical Learning Theory, John Wiley & Sons, New York
Yoon, M., Yun, Y.B. and Nakayama, H., (2003) A Role of Total Margin in Support Vector Machines, Proc. IJCNN'03, 2049–2053
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer
About this chapter
Cite this chapter
Nakayama, H., Yun, Y. (2006). Generating Support Vector Machines Using Multi-Objective Optimization and Goal Programming. In: Jin, Y. (eds) Multi-Objective Machine Learning. Studies in Computational Intelligence, vol 16. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-33019-4_8
Download citation
DOI: https://doi.org/10.1007/3-540-33019-4_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30676-4
Online ISBN: 978-3-540-33019-6
eBook Packages: EngineeringEngineering (R0)